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CHAPTER  1 

INTRODUCTION  AND  SUMMARY 

The  principal  purpose  of  this  dissertation  is  to  state  and 


prove  a limit  theorem  which  justifies  a diffusion  approximation  for  j 

general  queueing  networks.  In  this  chapter  we  begin  by  presenting  a :] 

■ i 

known  result  for  single  server  queues  in  heavy  traffic.  The  main  result 

of  this  dissertation  is  the  extension  of  this  single  server  queue  result  f 

to  general  queueing  networks.  A description  of  the  class  of  queueing 

networks  considered  is  given  in  Section  2.  In  the  same  section  we 

also  describe  the  associated  process  of  interest  to  us  here, 

S “ t > O'' , the  vector  process  of  queue  lengths  in  the  network.  j 

We  then  describe  exact  results  which  have  been  previously  obtained 

for  such  queueing  networks.  The  next  three  sections  of  this  chapter 

briefly  describe  the  new  results  of  this  dissertation.  Section  h contains 

•*  * 

a definition  of  the  vector  diffusion  process  Z = {Z  t),  t > 0] 

which  is  advanced  as  an  approximation  for  g.  The  limit  theorem  justify-  | 

ing  the  approximation  is  stated  in  Section  and  some  properties  of  ; 

the  process  Z are  discussed  in  Sections.  In  Section  7 we  show  how  '| 

one  chooses  the  correct  diffusion  approximation  for  a particulsir  queue- 

ing  network.  Finally,  we  present  some  of  the  nctational  conventions  ,ij 

f: 

used  in  this  dissertation  in  Section  8.  ;l 

'i 

In  Chapter  2 we  present  technical  preliminaries  from  weak  con- 

vergence  theory.  We  construct  the  probability  space  which  supports  our  ■] 

t 
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and  reflected  random  walk  on  this  probability  space,  and  prove  appro- 
priate weak  convergence  limit  theorems  for  these  processec.  In  Chapter  h 
we  construct  our  queueing  network  on  the  probability  space  introduced 
in  Chapter  3.  We  also  constmict  two  modified  queueing  networks,  which 
are  used  in  the  proof  of  the  main  limit  theorem.  The  main  result  of 
this  dissertation,  a weak  convergence  limit  theorem  for  the  vector 
queue  length  process,  is  stated  and  proven  in  Chapter  5.  We  study 
properties  of  the  limit  process  in  Chapter  Finally,  in  Chapter  7 
we  indicate  how  cur  limit  theorem  can  be  extended  to  cover  more  general 
types  of  queueing  networks,  such  as  those  with  multi-server  stations. 


1.1.  A Heavy  Traffic  Limit  Theorem  for  Single  Server  Queues 

In  this  section  we  state  a known  result  for  GI/G/1  queues  in 
heavy  traffic.  This  result  is  actually  a special  case  of  a theorem 
for  more  general  systems  treated  by  Iglehart  and  Whitt  'l970a,b). 

These  results,  as  well  as  other  heavy  traffic  work  done  before  1975, 
are  surveyed  by  Whitt  (I9^h), 

We  begin  with  the  standard  definition  of  a Gl/G'l  queue. 

Thus  we  have  mutually  independent  sequences  of  i.i.d.  random  variables 
which  function  as  interarrival  and  service  times  for  the  system.  The 
interarrival  times  are  distributed  as  u and  the  service  times  are 
distributed  as  v.  We  define 


o 


..  = l/Elv]  > 0 , 
A - l^E[u]  > 0, 


s - vai*(v'l  > 0. 
a =■  var(u)  > 0 . 


0^  = + u^s, 


p = A/p,  and  a = 1-p  . 

The  queue  length  process  Q = {<i(t),  t > 0}  Is  constructed  in  the 
standard  manner  using  the  interarrival  and  service  time  sequences. 

Roughly  speaking,  ve  say  that  the  GI/5/l  system  is  in  heavy 
traffic  when  the  traffic  intensity  o is  close  to  unity.  The  precise 
mathematical  interpretation  of  heavy  traffic  involves  consideration 
of  a sequence  of  queueing  systems,  indexed  'say)  by  n = 1,2,..., 
each  with  its  own  parameters  and  defined  in  such  a v&y  that  -> 1. 

We  denote  sequential  dependencies  by  appending  indices  on  quantities 
of  interest.  We  assume  that  n » meaning  that  ^ 

from  below  as  n -><».  Before  stating  the  limit  theorem  we  need  to 
define  the  limit  process,  which  in  this  one-dimensional  case  is  reflected 

Brownian  motion.  Let  X = {X(t),  t > 0}  be  a Brownian  motion  with 

2 

drift  c and  variance  cr  . Define 

Z(t)  = X(t)  + Y(t)  , t > 0 , 

where 

Y(t)  = - inf  {X(s)l  . 

0<  s<t 

Then  Z = {Z(t),  t > 0’  is  reflected  Brownian  motion.  Note  that 
Y = {Y(t;,  t > 0''  could  alternately  be  defined  as  the  minimal 
nondecreasing  and  nonnegative  f'onction  of  X such  that  Z(t>  > 0 


for  all 


t > 0. 


THSOHEM.  Suppose 


i 

a t 

n 

0 as  n -4  00  , 

! ii) 

a(n) 

-»  a as  n -» 00, 

iii) 

s(n) 

->  s as  n -4  00, 

iv) 

.'A(n) 

- u(n)]/Q!^  c as  n -^co, 

v) 

sup 

E((v^(n)  < 00  for  some 

n>l 

T P+€ 

Vi)  sup  S([u^(n)]  ) < oo  for  some  c > 0 . 

n > 1 

Then  =^Z(-)  in  D as  n -»<»,  where  Z = {Z{t] , t>0} 

2 6 3 

is  reflected  Brownian  motion  with  drift  c and  variance  c = A a + u s. 

The  interpretation  of  the  above  theorem  which  is  useful  for 
applications  is  the-t  for  small  % is  distributed  approximately 

like  Z(t). 

1.2.  The  General  Network  Model 

The  queueing  network  model  considered  here  is  identical  to 
that  first  studied  by  Jackson  (1957),  with  two  changes.  First,  we 
only  consider  a network  with  single  server  stations.  (This  is  only 
for  ease  of  exposition.  The  multi-server  case  is  covered  in  Chapter  7.) 
The  second  and  more  important  change  is  that  Jackson’s,  distributional 
ass’umptlons  have  been  dropped.  He  assumed  exponential  interarrival 
and  ser/ice  times,  but  we  allow  a general  form  for  these  distributions. 
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The  network  consists  of  K stations,  each  of  which  acts  as 
a single  server  queue.  An  example  with  2 stations  is  pic-'-ured  schemtically 
in  Figure  1.  There  is  no  hound  placed  on  the  queue  length  at  any  station. 


FIGURE  1.  The  Two  Station  Network 

For  the  sake  of  concreteness,  we  ass’ome  the  queue  discipline  to  he 
first-come-first-served.  An  easy  generalization  of  this  is  given 
in  Chapter  7.  Each  station  may  have  its  own  input  process  from  outside 
the  network,  and  at  least  one  station  must  have  such  an  input  process. 

In  the  conventional  terminology,  we  are  dealing  here  vmth  an  open  net- 
work. Customers  coii^)leting  service  at  station  i are  routed  to  station  j 
Vhere  they  ^oin  the  queue}  with  prohahility  p^^.  Thus  the  routing 
Is  described  by  a K x K matrix  P,  which  must  be  substochastic  in 
the  sense  that  at  least  one  row  sum  must  be  strictly  Less  than  one 
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and  no  square  submatrix  can  be  stochastic.  The  defect  of  each  row 
gives  the  probability  for  a customer  to  leave  the  network  after  com- 
pleting service  at  the  corresponding  station. 

We  assume  an  underlying  probability  space  (Q,^, P)  on  which 
are  defined  mutually  independent  sequences,  of  i.i.d.  random  variables 
which  are  used  as  interarrival  times,  service  times  and  routing  indi- 
cators for  the  network.  The  interarrival  times  to  station  k (from  out- 
side  the  system^  are  distributed  as  u , and  the  seri'-ice  times  at 
station  k are  distributed  as  v‘  . We  define  (for  1 < k < K) 

= I/EIv'*^]  > 0 , ®k  ~ ■''■s-r(v^)  > C , 

= l/E[u^]  > 0 , \ ~ var(u^)  > 0 . 


Denote  by  'the  number  of  customers  w’ho  have  arrived  to  station  k 

from  outside  the  system  during  the  interval  (0,t].  Thus  - 0 

for  t > 0 if  station  k has  no  inpu;;  process  from  outside  the  system. 

Our  ass’uraption  of  mutually  independent  i.i.d.  interarrival  time  sequences 


is  eouivalent  to  assuming  that  the  are  independent  renewal  processes. 

Associated  with  station  k we  define  a process  fSj^(t',  t > 0] 
vdiere  S^(t)  denotes  the  number  of  customers  who  have  completed 
service  at  station  k during  the  interval  ,0,t].  Additionally,  let 


S.  .(t)  denote  the  number  of  customers  who  have  completed  service  at 
station  i during  the  inteimral  '0,t''  and  were  then  immediately  routed 
to  station  J.  If  d. . = 0 then  S.  .(t)  =0  for  all  t > 0.  We 

clearly  have 
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s^(t)  > r . 

We  will  henceforth  assume  that  p.,  =0,  so  that  S..(t)  = 0 for 
all  t > 0.  This  assumption  is  without  loss  of  generality.  (See  Chapter  7.) 

The  process  of  interest  to  us  here  is  the  vector  process  of 
queue  lengths  (including  customers  in  service,  if  any)  at  the  stations 
of  the  network,  net  denote  the  n’lmber  of  customers  at  station  k 

(called  the  queue  length  from  now  on'  at  time  t.  We  then  obviously  have 

K 

(2)  \(t)  =\(t)  + - Sj^(t). 

Let  g(t)  = (Q^(t),  QgCt),  ...  , Qj^(t)).  To  complete  the  description 
of  the  vector  queue  length  process  we  need,  to  specif5f  initial  conditions. 

We  assume  that  the  entire  network  is  empty  at  t -=  0-.  This  particular 
initial  condition  makes  the  statement  and  proof  of  the  limit  theorem 
somewhat  neater  than  it  would  otherwise  be.  The  initial  conditions 
actually  have  no  effect  on  limit  theorems  like  ours,  as  has  been  pointed 
out  by  Whitt  (1968). 

We  now  define  a traffic  intensity  for  each  station  in  the  net- 
work, following  Jackson  (1957).  The  traffic  intensities  are  defined  in 
terras  of  quantities  Xyi  ^ which  we  call  'net  arrival  rates'. 

We  define  x,  ~ ("Tt,...,  Tj^)  as  the  unique  solution  of  the  equation 

(5)  X = i ^ X? 


\ 

\ 

A 
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where  X = (X^ , . . . , X^)  is  the  vector  of  arrival  rates  and  P is  the 
routing  matrix.  Since  P is  strictly  substocbastic  ;t  is  well  known 
(cf.  Jinlar  (1975)}  that  (l-P)  is  invertible  and 

R s (I-P)"^  = E P”  . 

n=0 

From  the  definition  of  P it  is  then  easy  to  show  that  represents 

the  expected  number  of  visits  to  station  J by  a customer  who  enters  the 
network  at  station  i.  Clearly  (5)  is  uniquely  solved  by  X ~ ^ 
the  interpretation  of  as  a net  arrival  rate  at  station  j then 

follows  from  the  interpretation  of  R.  The  traffic  intensity  at 
station  J can  now  be  defined  as 

V 

, 1 < i < K . 


1.3,  Literature  of  Queueing  Networks 

The  first  work  on  aueueing  netvrorks  was  done  over  twenty  years 
ago  by  Jackson  {Y-ff'].  The  network  model  he  considered,  as  explained 
in  Section  1,  is  the  same  as  that  described  above — with  two  changes. 

He  allowed  an  arbitrary  finite  number  of  ce:’vers  at  each  station  and 
required  that  all  interarrival  and  service  time  distributions  be 
exponential. 

Jackson  studied  the  vector  stochastic  process  representing  the 
number  of  customers  at  each  station  in  the  network.  Because  of  his 


distributional  assumptions  this  process  is  Markov.  Jackson  defined 
the  traffic  Intensities  , 1 < i < K,  as  in  the  lest  section.  Let 
7!  (n^, . . . , n^^)  be  the  stationary  probability  of  state  (n^ , . . . , n^) 
when  it  exists. 

Jackson's  main  result  (specialized  to  the  case  of  a single 
server  at  each  station)  states  that  the  stationary  distribution  exists 
if  < 1 for  all  i 1,  . . . ,K  and 


^1) 


•Tri,n, 


1,  . . . , 


K 

= IT 
i=l 


(1-D, 


1 0. 


Since  Jackson 's  original  paper,  a great  deal  of  work  has  been 
done  aimed  at  extending  his  results.  Tlie  main  objective  of  this  work 
has  been  to  increase  the  complexity  of  the  network  while  retaining  the 
product  form  .solution  for  the  stationary  distribution.  We  will  be 
rather  brief  in  our  discussion  since  this  ?-iterature  has  been  sur\'eyed 
recently  by  Lemoine  (1977). 

The  first  extension  was  actually  made  by  Jackson  (1965)  himself. 
He  extended  his  original  model  to  allow  the  arrival  processes  to  depend 
on  the  number  of  customers  in  the  network.  He  also  allowed  the  service 
rate  at  a station  to  depend  on  the  number  of  customers  at  that  station. 
Gordon  and  Newell  (I967)  treated  a closed  network  (fixed  totai  number 
of  customers).  They  allowed  the  same  service  rate  dependence  as  in 
Jackson  ^1963).  Posner  and  Bernholtz  (196/ ) generalized  the  results 
of  Gordon  and  Newell.  They  allowed  several  different  classes  of 
customers  in  the  network,  each  class  having  its  ovm  routing  probabilities 
and  service  rates.  They  also  allowed  arbitrarily  distributed  travel 
times  between  stations.  Kelly  (l975)  considered  both  open  and  closed 
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networks  'wit^  different  classes  of  customers  and  different  types  of 
service.  The  service  stations  could  be  multiserver,  infinite  server 
or  processor  sharing. 

In  all  of  the  work  described  above  the  one  common  restriction 
is  to  exponentially  distributed  service  times.  There  has  been  some 
work  done  aimed  at  lifting  this  restriction.  Perhaps  the  most  general 
model  is  that  of  Baskett,  Chandy,  Muntz  and  Palacios  (1975)  (further 
generalized  by  Kobayashi  and  Reiser  (1975)).  They  allow  several  classes 
of  customers,  with  customers  able  to  change  class  upon  leaving  a 
station.  The  service  distribution,  routing  probabilities  and  arrival 
processes  all  can  depend  on  the  class.  All  external  arrival  processes 
are  Poisson  processes.  It  is  possible  for  the  network  to  be  open  with 
respect  to  some  classes  of  customers  and  closed  with  ':'espect  to  the 
others.  The  service  stations  may  be  one  of  four  types:  first-come- 
first-served  (FCFS),  processor  sharing,  infinite  server,  and  last-come- 
first-served  pre-emptive  resume.  The  service  times  at  all  but  FCFS 
stations  may  have  any  distribution  with  rational  Laplace  transform. 

At  FCFS  stations  the  service  time  distribution  must  be  exponential 
and  all  classes  must  have  the  same  distribution. 

Kelly  (1976)  deals  with  a system  having  several  classes  of 
customers  where  each  class  has  a fixed  route  through  the  network. 

Kelly  gets  results  similar  to  those  of  Baskett  et  al. , showing  that 
for  all  types  of  disciplines  except  FCFS  a product  form  solution  is 
obtained  when  service  times  are  finite  mixtures  of  Gamma  distributions. 
Barbour  (1976)  extends  this  result  to  hold  for  all  arbitrarily  distri- 
buted service  times  using  weak  convergence  arguments. 
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with  models  having  non-exponential  service  times  these  less  restrictive 

distributions  have  been  tied  to  disciplines  other  than  first-come-first-  j 

served.  A closer  examination  of  these  results  will  show  that  the  | 

stationarj'  distributions,  all  roughly  of  the  form  (1),  only  depend  on 

the  meajis  of  the  service  times.  Thus  the  variance  'and  higher  moments' 

of  service  times,  xg’hich  are  known  cc  have  a significant  :.rr.pact  in 

single  server  queues,  have  effectively  been  ignored  in  all  the  work 

described  above. 

There  has  also  been  work  of  a different  character  done  on 
queueing  networks.  This  involves  analyzing  networks  by  decomposing, 
them  into  smaller  pieces,  analyzing  the  pieces  and  then  putting  them 
back  together.  This  research  has  thu.s  far  been  aimed  to'wards  character- 
izing output  processes  from  single  server  queues  and  studying  the 
behavior  of  queues  which  use  these  output  processes  as  input  processes. 

Work  has  also  been  done  on  feedback  queues  as  well  as.  thinning  and 
superimposing  output  flov.-s.  Much  progress  has  been  made  but  no 
results  have  been  obtained  w'hich  enable  a discussion  of  queue  length 
distrib’.itions  in  a network.  Work  in  this  area  is  dealt  with  in  -a 
survey  s.rticle  by  Disney  (1^75'). 


(2) 


! 


z*(t)  = X*(t)  + (l-p-)  Y(t) 

where  P is  the  routing  matrix  anfl  Y = (Y(t)j  t > 0}  is  described 

as  the  minimal  ('component  by  component)  non-decreasing  function  of  X 

such  that  Z (t)  >0  for  ail  t > 0,  It  will  be  shora  in  Section  ^..2 

that  this  definition  'of  Y sind  hence  Z is  in  fact  ’onambiguous. 

* 

The  orocess  Z is  a diffusion  whose  state  soace  is  the  non- 
~ - 

K K 

negative  orthant  of  3P.  , hereafter  denoted  ]p^.  On  the  interior  of 

X-  -x 

its  state  space,,  Z behaves  like  the  Brownian  notion  X . It  reflects 

in  the  direction  e.-p,,  from  the  boundary  corresponding  to  Z.  (t  - 0, 

’/rtiere  e.  is  a unit  vector  in  direction  i,  and  p.  is  the  ith  row 
1 1. 

of  P).  For  the  network,  depicted  in  Figure  1,  the  directions  of 
reflection  are  shown  in  Figure  P. 


FIGURE  2.  Directions  of  Reflection  for  a 2 Station  Network 
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1.5.  The  Limit  Ttieorem 

We  now  consider  a sequence  of  queueing  networks  of  the  type 

defined  in  Section  2,  indexed  hy  n > 1.  The  notation  of  Section  2 

is  retained,  with  indices  appended  to  quantities  of  interest.  Heavy 

traffic  for  the  netwrk  means  that  p?  ->  1 as  n for  i = 1, 

It  is  convenient  to  describe  the  result  in  terms  of  ct  = min  ■'l-o?''. 

^ l<i<K  ^ 

In  this  section  >ve  deal  only  with  the  case  where  o?  ->  1 from  below 


for 

all  i = 1, 

V 

THEOREM.  Suppo 

se 

i) 

a 10  as  n 00, 
n 

ii) 

a^  (n)  a 

as  n -eoo  for  1 < i < 
1 — — 

K, 

iii) 

s^(n)  s 

as  n for  1 < i < 

1 — — 

K, 

iv) 

(v.(n)  - 

u^Cn)!/^^  as  n -^00 

for 

1 < i <;  K, 

v) 

max 

l<i<K 

sup  E([vr'.n) < M for 
n>l  ^ 

some 

e > 0. 

•H 

> 

max 

1<  i<K 

sup  E^'u^fn)]''"*”^;  < 00  for 
n>i  ^ 

some 

e > 0 . 

Then 

a Q’’(t/o!^ 
n-i  ' n 

* , 

) ^ Z ;t)  as  n -»oc  wher*^ 

*■ 

> Z 

= (z'^^'t),  t 

Brownian  motion  in  F.  , with  drift  vector  c,  covariance  matrix  t, 

-i. 

where 


J 


t - 


•11  12 


'12  ^22 


2 

\ “"iK 


KK 


with 


(5) 


and 


(M  a-^  = 

•‘•c; 


^ii  = ^ - -^^k4"r'  1 i < K 


3 3 K 


and  reflection  in  direction  e.  -p^.  from  the  boundarj’  corresponding^ 
to  Zf  = 0. 

In  Chapter  5 the  limit  theorem  is  stated  and  proven.  There 
-1/2 

we  take  = n -with  no  loss  of  generality.  This  choice  for 

m;akes  it  easier  to  refer  to  existing  results  from  weak  convergence 
theory . 


iJi 


As  might  he  suspected  from  the  fcm  of  the  stationary  dlstri- 


.1 
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hution>  this  family  of  limit  processes  corresponds  precisely  to  limits 
achievable  by  sequences  of  Jackson  networks. 


1.7.  Approximating  Stable  Queueing  Networks 

The  limit  theorem  stated  in  Section  5 suggests  that  we 

p 

approximate  Qg(t''a')  by  Z*(t)  when  o is  small.  The  parameters 
of  the  limit  process  Z*  arise  as  limits  of  parameters  from  a sequence 
of  queueing  networks.  In  general,  one  has  a single  network  for  which 
a diffusion  approximation  is  desired.  The  correct  choice  of  parameters 
for  Z*  is  straightforward.  It  involves  matching  the  infinitesimal 
drifts  and  covariances  of  Q and  Z*.  Carrying  out  these  calculations, 
we  obtain  the  following  values  for  the  parameters  of  Z*-. 


1 

I 


! 


min  (l-o, ) > 0 , 
l<i<X 


Cf  = (v^-u^)/0' 


for  1 1 i 1 K, 


Li 


K 


'^‘xi  = ^ ^^i  ^ A 


£=1 


ror  1 < i < K, 


and 


■'ll  ' 1 ; i < 0 < K. 


The  reflection  directions  are  given  by  for  - £ i £ K. 


IC 


Although  we  offer  no  rigorous  justification,  it  is  tempting  to 


r 


( 


approximate  the  stationary  distribution  of  cig  by  that  of  Z*-.  This 
is  the  reason  for  our  interest  in  the  stationarj'  distribution  of  Z'*'. 

The  use  of  a diffusion  approximation  for  both  transient  and 
stationary  distributions  of  oueueing  networks  was  originally  proposed 
by  Kobayashi  (197^).  The  open  network  that  he  studied  is  essentially 
equivalent  to  that  treated  here.  The  diffusion  approximation  he  advanced 
is  a multidimensional  Brownian  motion  restricted  to  the  non-negative 
orthant.  His  work  involves  no  proofs,  but  contains  a heuristic  justifi- 
cation. He  never  explicitly  considered  the  behavior  of  the  diffusion 
at  the  boundaries,  which  is  more  complicated  than  in  the  one-dimensional 
case.  As  a result  of  this,  the  diffusion  was  never  completely  specified. 
Kobayashi  wrote  out  the  forward  equation  for  the  Brownian  motion  and 
dealt  with  the  related  steady-state  solution,  obtained  as  the  solution 
to  the  forward  equation  with  the  time  derivative  set  to  zero.  The 
equation  he  solved  was  precisely  (5' . Although  Kobayashi  obtained  a 
solution  to  (5),  it  does  not  always  sa.tisfy  (6).  There  are,  however, 
certain  cases  for  which  his  solution  is  correct,  and  these  are  discussed 
in  Chapter  6. 


1.8.  Notation 

We  briefly  indicate  here  some  of  the  notational  conventions  used 


I 


within  chapters,  ’^Ith  the  numbering  starting  anew  in  each  chapter. 

Within  the  same  chapter,  propositions,  lemmas,  anr"  equations  are 
referenced  simply  by  their  number,  whereas  cross  chapter  references 
also  require  a chapter  number.  Thus  equation  (proposition,  lemma)  1 
of  Chapter  2 is  referenced  to  as  (2.^  outside  of  Chapter  2,  and  as  (^) 
inside  Chapter  2.  Theorems,  on  the  other  hand,  are  nu.mbered  consecutively 
throughout  the  dissertation  and  thus  require  only  one  n'jmber  for 
identification. 

When  there  is  any  chance  of  confusion,  we  unlerscore  vectors 
with  ~.  All  vector  functions  ajid  vector  stochastic  processes  are 
underscored  with  ~.  Matrices  will  be  obvious  from  context  and  so  are 
not  indicated  in  any  special  way.  We  use  several  different  norms,  most 
of  vdiich  we  denote  by  I*!.  The  specific  norm  used  is  generally 
obvious  from  the  nature  of  its  argument.  When  there  is  a chance  of 
confusion,  the  type  of  norm  being  used  is  explicitly  stated. 
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CHAPTER  2 
PRELIMINAPIES 

In  this  chapter  ve  present  results  from  -rfeak  convergence  theory 
which  will  he  used  in  the  proof  of  the  main  limit  theorem.  The  first 
section  contains  known  results  and  the  second  section  contains  two 
new  results. 

2.1.  Weak  Convergence 

We  begin  by  briefly  sketching  the  notation  and  terminology  that 
we  use  for  weak  convergence.  The  reader  is  assu-med  to  have  a basic 
familiarity  with  this  material.  Billingsley  (1968)  is  the  standard 
reference  in  this  area. 

K 

We  will  consider  a sequence  of  processes  with  paths  in  D '0.1’ 

(=  D ),  the  space  of  all  right  continuous  f’j.nctions  from  '^0,11  into 
K 

IR  having  left  limits.  This  space  is  a complete  separable  metric 
when  endowed  with  the  Skorohod  metric  d.  We  never  need  to  explicitly 
deal  with  d and  so  we  do  not  define  it  hers.  Our  limit  process  has 

paths  in  C 0,1"  (=  C ),  the  space  of  all  continuous  f'anctions  from 

K K 

0.1'  into  IR'  . The  r.etric  for  C is 


We  use  the  symbol  to  denote  weak  convergence.  The  same 
symbol  is  used  for  both  probability  measures  and  random  functions. 

Although  the  sequence  of  stochastic  processes  we  deal  with  are 

K K 

in  D , we  can  effectively  treat  them  as  elements  of  C when  it  is 

convenient.  This  is  because  of  the  following  result  of  Liggett  and 

Rosen,  proven  in  Whitt  (1968). 

Proposition  2.  Let  {X^,  n > I't  be  a seque.nce  of  random  functions  in 
(D, d),  {Y^,  n > 1]  a sequence  of  random  functions  in  (C,o),  and  X 
a random  function  in  (C,  o).  If  d(X^,  ^0  as  n then 

X^  ^ X in  (D,d)  as  n -» <»  if  and  only  if  Y^  ^ X in  (C.p)  as 
n -)  00. 

K K 

The  generalization  of  the  result  to  T and  D is  immediate. 
We  will  never  need  to  deal  with  d because  d(x, y)  < p(x,y)  for 
X,  y € D . 

We  now  state  several  results  for  weak  convergence  of  stochastic 
processes  formed  from,  i.i.d.  random  variables.  The  limit  process 
is  Brownian  motion  in  all  cases.  The  first  result  is  due  to  Prohorov 
(1956)  a-nd  is  stated  here  under  slightly  stronger  conditions  than  are 
necessary,  since  they  are  easier  to  verify  in  our  applications. 

Proposition  2.  Let  {X^,  i > 1,  n > 1'  be  a double  sequence  of  random 
variables  which  are  i.i.d.  for  each  n > 1.  Assume  that 


i 

i 


r 


20 


J denotes  the  integer  part  of  the  argument.  Then  p.  4.  e 


where 


where  ? is  standard  (no  drift,  'onit  variance;  Brownian 


The  following  is  an  associated  result  for  a process  formed 


from  a random  sum  of  random  variables.  It  is  proved  a.s  Theorem 


i > 1.  n > 1}  be  a double  sequence  of  random 


variables  satisfying  the  hypotheses  of  Proposition  P.  La 


be  a renev;al  process  with  rate  > 


The  next  result  deals  with  weak  convergence  of  renewal  processes 


It  is  Theorem  17.3  of  Billingsley 


Proposltlcn  Let  i > 1,  n > 1)  be  a double  sequence  of 

positive  random  variables  which  are  i.i.d.  for  each  n ^ i.  Assume 
that  E''u^]  = (0  < < »)  and  _>  X (O  < A < <»)  as  n -» «. 

Let  X?  = u”  - and  assume  that  (X^,  ^ ^ n > 1]  satisfies 
the  hypotheses  of  Proposition  2.  For  n > 1 let 


A^(t)  = 


maxf  J > ij  E u?  < t] 
i=l  ^ 


for.  < t 


for  u^  > t 


and  let 


= (cr^X^n)  [A^(nt)  - X^nt]  for  0 < t < 1 and  n 


Then  t]  ^ 5 in  ("D,  d)  as  n 


2.2.  Asymptotic  Nonpositivity  of  Supermartingales 

We  now  present  two  results  dealing  with  supermartingales  which 
show  that  in  a certain  sense  they  are  asymptotically  nonpositive. 

These  results  anpear  to  be  new  and  so  are  nroven  here. 


Let  (O,^, P)  be  a probability  space  with  an  increasing  sequence 

of  sub  c-fields  n > 0],  so  that  c for  all  n > 0.  Let 

(x  , n > 11  be  a sequence  of  random  variables  such  that  x is  ^ 
n — n n 

measurable  for  all  n > 1.  Assume  that 


! Cfi  1 ] < 0 for  n > 1 
n'  n-1  - — 


var[x  I "i  , ] < C 
n'  “^n-l  — 


< <»  for  n > 


If  we  set 


= Z X. 

n 1 


then  {X  . n > 1]  is  a supermart in^tale  adaoted  to  f . n > 01.  Let 
n — ' ' ' n'  — 


- E[x^!^^  for  i > 1- 


Y Z V. 
n 1 

i=l 


for  n > 


Then  {Y  , n > 1)  is  a martingale  adapted  to  f 3^  , n > 01  with 
n — n — 

Y > X for  n > 1. 
n — n — 


Proposition  '5.  Suppose  that  {3‘  , n > II  is  a sequence  of  random 
functions  in  (D,  d)  with  ^ P in  (D,d),  where  P is  a Bro\'mian 

motion  with  finite  drift  and  variance.  Let 


= - Inf  {P'^(t)'| 
C<t<l 


Pf  max  X.  > x/n  s)  _>0  as  n -voo  for  all  e > 0 


P{  max  |Yj>.'nf''-»0  as  n-**  for  all  e > 0. 


1 


Proof.  Let  z - - inf  {B(t)),  The  continuous  mapping  theorem 
0<  t<  1 

(Billingsley  (l'?>6^'.  Theorem  5.5)  gives  ^ z in  R since 
^ 3 in  D.  By  well  known  results  for  Brownian  motion,  z has 
finite  expectation  and  hence  is  aimost  surely  finite.  Thus  for  every 
> 0,  there  exists  e,n  < oo  such  that 


P{z  < r’  > 


In  addition,  there  e.xists  an  N such  that  if  n > N,  then 


!p{z  < nl  - P(  z'^  < 'il  ! < ^ . 


because  z =>  z.  Patting  these  two  facts  together. 


P{  z*^  < -1 ) > 1 - I for  n > N . 


We  work  henceforth  on  the  set  { z < hi  where 


max  0 

i'  ^ ^ 

1 < ^ < z"  1 < £ <Ti  » n 


max  Yj  < max  Y,  . 

' i!  - f. 

1 < i < z'^  V ' n < ’'1  \ ^ 

By  the  maximal  inequality  for  martingales  (ihung  (l97^,  Theorem  '^.h.l') 


P{  max  |Y^1  > y/n  f ■’  < (n<  ) varf'Y  ) , 


For  1 < i < j,  e:y,Yj]  - E(E[Y^Y^!5t^._^l)  = E(Y^E  Y^j  9lj_3_])  = 0 

by  the  independence  of  Y.  and  E[Y.  | i.  Thus  var^i"  ) 

_ " " !lv«) 

< Ct)  /n.  Choose  N'  > N so  that 


Cti/c^  < I 


and  the  result  for  Y.  follows.  The  result  -^or  X.  is  obtained  upon 


noting  that 


X,  • 


Proposition  6.  If  EfxJ  < -c  < 0 for  i > 1 then 


P[  max  X > as  n-)oo  for  all  t > 0 


l<i<n 


Proof,  We  have 


?{  max  X > v/n  e}  = P{  max  Y > ^'2,  max  X > y/n  e"' 

l<i<n  l<X<y^^  l<,<'<n'^ 


+ P{  max  \ “ ^ ^2.  max  X > yn 

1<^<  y/n  ' \'n<;?<n 


1 p{ 

max 

e '2f 

+ P{  inax 

1<  £ < V' n 

1 < ^ 

< p( 

max 

e/2} 

+ P[  max 

l<i< 

it 

l<  ;< 

9y  y n 


> > c j max  Y < c '2 ' 
l<£<y'r:  ^ 


1 


1 


Aere  Y'  = Y - Y , The  last  inequality  results  from 

i+.  v'n]  f V^] 

£ 

_ V 


^i+  v'n 


< (e  2 - q) 


Jsin#?  the  maximal  inequality  as  in  Proposition  5, 


and 


P{  max  Y . > *■  1 \ ^ 

1<;<  V'n 


P{  max  Y.  > nci  < c nc'^ 
l<i<n  ^ 


We  can  simultaneously  make  these  as  small  as  we  like,  and  the  proposition 
follows. 
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CHAPTER  5 
THE  RAHTWM  WALK 


la  this  chapter  we  define  a type  of  random  walJs  on  the  integer 

lattice  of  ]R  . The  random  walk  is  defined  in  Section  1.  In  Section  2 

K 

we  introduce  a mapping  which  transforms  the  random  walk  in  ]R  into 
a 'reflected  random  v/alk'  (RRW)  in  IR^.  We  then  consider  a sequence 
of  random  walks  and  RRW's  In  Section  3,  proving  limit  theorems  for  both 


The  K X K matrix  P = ^ 1 < i < K1  is  assumed  to  be 

substochastic  in  the  sense  that  no  souare  submatrix  i ■-  stochastic. 

When  we  define  the  queueing  network,  the  will  function  as 

interarrival  times  to  station  k.  the  v.^'s  will  function  as  service 

k 

times  for  station  k,  and  the  will  function  as  routing  indicators 

for  customers  seiu'^ed  at  station  k.  The  matrix  P is  therefore  called 

the  routing  matrix.  The  situation  where  = 0 corr«»sponds  to  station 
k having  no  arrival  stream  from  outside  the  network. 

We  now  construct  renewal  processes  in  terras  of  the  i.i.d. 
sequences'  defined  above.  Let 


0^(0'  = 0 , 


0-^(0)  = 0 , 


We  define 


cAP.  ) = • Z v' 
i=l  ^ 


P > 1 


Aj^(t)  = sup{.£  > 0:Q£j^'f)  < t' 


1 < k < K.  t > 0 , 


S (t)  = sup{J!  > 0:0.  < tl  . 1 < k < K.  t > 0 . 


Routing  vectors  are  defined  by 


i'k  ^ ^ i ’ 


where  e.  is  a vector  with  a one  in  the  ,ith  position. 


Let 


i > 1}  for  1 < k < K , 
A " i > 1]  for  1 < k < K , 


K K 

^ = 'j  ’ ><l  = U «/.  , and  0"  = ^ 'J 


Let  the  following  three  sequences  be  enumerations  of  Ci,  J and  !j 


respectively: 


a(l’'  < a(2)  < 


We  define  the 


ct(1)  < a(2)  < • • ' 

t(l)  < b(2j  < ••• 


processes  S.  , = {S  (t),  t > 0]  for  !-  < : < K as  the 


components  of  the  vector  process 


Sk{t' 

ii  ■ 


^k  " ^^k’~k^  ^ " ^^1  ' * ' 


S y ) . We  can  now  define  our 
— > \ 


random  walk.  Let 


(!''  Xj^(t)  = Aj^(t)  + E S^j^(t}  - Sj^(t)  for  t > 0 and  1 < h < K. 

Let  X = {X(t),  t > 0)  be  the  vector  process  whose  component  processes 
are  the  Xj^  = {Xj^(t),  t > 0) . We  call  this  a random  :^•alk,  although 
this  usage  stretches  standard  terminology  a bit.  Let 


(2) 


The  vector  is,  loosely  speaking,  the  drift  of  X. 

We  construct  an  increasing  family  of  sub  cr-fields  { ^ , t > 0 

t 

by  setting 


3k  = a{A^(u),  Sj^(u),  cpf  ; 1 < k < K,  0 < u < t,  1 < ij,  < Sj^ft)} 

“k 


for  all  t > 0.  We  can  define  a related  increasing  sequence  of  sub  a-i 
i > 0}  by 

1 

X 

The  sample  paths  of  X are  elements  of  2‘  . At  certain  points 

I 

in  the  development  it  is  easier  to  deal  with  the  related  process  in  C 
obtained  from  X by  linearly  interpolating  between  the  jumps.  Toward 
this  end,  let 


1 1'' 


for  t(;}  < t < t(i+l)  . 


The  paths  of  W are  piecewise  linear. 


?0 


'ields 


J 


5.2.  The  Rfflectloa  Mapping 

We  now  present  a mapping,  vhicn  ve  call  f.  that  transfoms  a 

random  waUc  of  the  type  described  in  the  last  section  to  a reflected 

random  walk  (RRW)  which  stays  inside  of  IR  It  is  no  longer  restricted 

to  the  integer  lattice,  however.  The  mapping  f was  described  informally 

in  Section  l.U. 

K K 

Let  be  the  subset  of  D consisting  of  functions  which 

are  nonnegative  and  nondecreasing.  For  x D , let 


UCx)  = Cy  £ I?^[x(t)  + y(t)'’I-P]  > 0 for  all  t > 0} 


Proposition  1.  For  each  x £ V(x;  is  nonempty. 


Proof.  We  explicitly  display  an  element  of  U.  Let 


y^(t)  = mi't;R  for  t > 0 . 


where 


TL  (t)  = - inf  {x_  (s''’  A 0 , 
^ 0 «r  s < t ^ 


k - 1 K and  t > 0. 


and  R = (l-P)”  , as  described  in  Section  1.2.  We  have 


y°(t'  I-P]  = m(t)  , 


- A ^ ^ 


Since  ^ have 


T' 


r 


.(t)  + y^(t)  - E p^.i^yj(t)  > 0 , 


j=l 


k = 1, . . . .K  , 


for  all  t>0.  So  U CU(xE 

We  say  that  '£  £ U(x'  is  a minimal  element  of  U(x)  if 
— 1 < k < K,  t > 0,  for  all  jr  £ U(x).  It  is  clear 

that  if  such  a minimal  element  exists  then  it  is  unique. 

K 

Proposition  2.  For  each  x £ D , U(x)  has  a minimal  element. 

Proof.  Since  U is  defined  in  terms  of  weak  inequalities  it  is  clearly 
closed.  Suppose  - {y(t),  t > 0}  £U  and  t > 0]  u U. 

We  need  to  show  that 

X*  = A y^'(t),  ....  y^(t)  A y^(t)),  t > o)  £ u . 

There  are  ? possible  cases,  depending  on  vdiether  y/ (t)  > yJ'(t,' 

K ” K 

suffices  to  show  the  result  when  x' (t'  and 
differ  in  only  two  components,  since  we  can  get  the  ge.neral  case 
with  several  applications  of  this  special  case.  Without  loss  of 
generality  we  can  assume  that  the  first  two  components  of  y' (-t)  .and 
X''(t'  are  different  and  the  rest  are  the  same.  There  are  four  cases 
to  consider: 


0. 

< y{(t) 

and 

y^(t) 

1 y;'(t)  . 

ii)  y.',(t) 

> 

and 

y’(t) 

> y"(t:  . 

iii)  y'(t' 

< y''(t) 

and 

y’(t) 

> y;(t)  , 

iv)  y^(t> 

> y{(t) 

and 

y’,(t) 

c 

< y."(t  . j 

i 


For  case  i)  X"('^)-  Cpses 

iii)  ajid  iv)  are  symmetric  so  we  deal  only  with  iii]  . 

We  need  to  show 

K 


(5) 

x^(t)  + y^(t) 

- x:  p.iyj(t) 
J-3 

K 

(6) 

Xo(t)  + y^’(t) 

- Pi2y((t: 

- - 

j-3  ^ ^ 

(7) 

Xj^(t)  + y^(t) 

■!,  ’’ox''? 

for  k = 3, . . . ,K  . 


From  (iii)  we  have 


(8) 


(9) 


K 


Xi(t)  + y^(t)  - - Z p.jy\(t) 


3=y 


> x^(t)  + y[(t)  - P2^y^(t:  - t p.^yUt) 


j=5 


K 


X2(t)  + - Pi2y{(t)  - 

0 


The  expressions  on  the  right-hand  side  in  (3)-(l0)  are  nonnegative,  since 
e U(x).  Thus  we  have  (5)-(7),  completing  the  proof. 


In  the  next  section  we  will  apply  the  continuous  mapping  theorem 
to  obtain  weak  convergence  for  a sequence  of  RRW's.  To  do  this  we  need 
the  following  result. 


K K 

Proposition  3.  f:C‘  C is  continuous. 

Proof.  By  the  definition  of  continuity,  we  must  show  that  for  all  e > 0, 
there  exists  a b > 0 such  that  for  all  x,  x'  € C^,  if  3(x,x')  < 5 
then  oCf (x),f (x' ) ) < t- 

Let  y be  the  minimal  element  of  U(x)  and  let  y'  be  the 
minimal  element  of  U(x')-  Take  e > 0 to  be  given.  Showing  that 
i(y,y')  < e is  enough.  Choose  5 so  that  iSiRlj  < c where  1 is 
a vector  with  a one  in  every  position  and  |‘ | here  denotes  the 
Euclidean  norm.  If  p(x,x' ) < b,  then 


I 


2 = y + bRl  t U(x’ ) 
y'  = y’  + bP.l  t U(x'i  . 


We  show  that  £'  - 'J(x),  the  other  case  is  similar.  We  have  H 

' 1 

7’(t)=x(t  + y' (t)[I-P'  > X' (t)  - -1  + y’ (t}^I-P]  + blR'I-P’  pj 

|i 

= X'  (t)  + y’  (t)ri-P''  > 0 . ,1 


The  first  inequality  follows  from  the  definition  of  and  the  fact 

that  p(x,x' ) < B.  The  equality  follows  from  the  fact  that  R = II-PJ 
and  the  final  inequality  from  the  assimption  that  y’  G l)(x'). 

From  the  minimality  definition  of  y and  y'  we  have 

y - y'  i y'  - y’  = 

y'  - y < y - y = . 

so  that  “^(y^y')  £ £ - 

3.  Limit  Theorems  for  Random  Walk  and  RRW 

We  now  turn  our  attention  to  a sequence  of  random  walks  of  the 
type  described  in  Section  1.  We  thus  consider  a sequence  of  probability 
spaces  { (n",  Sfc”,p”),  n > 1} , each  element  of  which  is  similar  to 

(n,  3«,P)  of  Section  1 to  the  extent  that  it  has  seouences  of  random  | 

variables  as  described  in  Section  1 with  -^hich  we  can  construct  a I| 

random  ’/^Ik.  We  carry  forward  all  of  the  notation  established  in  j 

Sections  1 and  2 except  that  all  Quantities  which  deoend  on  n v.dll  ! 

‘i 

have  an  n appended  in  a convenient  place  to  signify  this  dependence.  |j 

Both  K and  P remain  fixed,  so  they  are  not  subscripted.  Let 

X^(t)  = n ^ x'^(nt)  for  0 < t < 1 and  n > 1.  f 

i 

i 


Theorem  1.  Suppose 

i)  u,,(n)  -» 


as  n -» «>  for  1 k < K, 


ii)  A,  (n)  -»  Ai,  as  n for  1 < k < K, 

iii)  ^ n ->«>  for  1 '£  A < K, 

iv)  s,  (n)  ^ s.  as  n for  1 < k < K, 

v)  { v.'n)  - u,  (n))  I'ri  ~ ->  c as  c,  < » 

If  iC,  iC 


for  1 < k < K, 


vi)  max  sup  E{  (v^(n' ) < <»  for  some  ■ > 0 , 

1 < k <K  a>l 

vii)  max  sup  E{  (u?(n) )“' < » for  some  ■ > 0 . 

1<  k < K n>i 


^^71  K 

Then  X X*  in  D as  n -> » . where  X'^-  is  K dimensional 
Brownian  motion  with  drift  vector  c and  covariance  matrix 


®’ll  °12 


°’l2  '^22 


where 


4i  * 4=1  * ,4  • -“»k  =■  I i ‘ < x 


"I'j  ‘ - ^ 4'*1  • 1 < 1 < j < «• 


Proof.  Let  A^'^(t)  = A"(nt)  - A^(n)nt].  Using  ii),  iii)  and 

^n  /~5 

vii),  Proposition  2.7  says  that  A^  V ^ n -)«>, 

for  k = 1,  ...,K,  where  3^, . . . , are  independent  standard  Brownian 
mot ions. 

Let 

st"(t)  = n"^'^^'S-;j(nt)  - u,  (n)nt], 


s;;(nt) 

V —I/2  o 
S,  (t)  = n L 

^=1 


and 


^(t)  = r,  («f  - 

^ i=l 


- p ) for  l<k<K,  0<t<l  and  n>l. 
'K  K* 


Using  i),  iv),  vi)  and  Proposition  2.7  once  again,  we  have 


k ^k  ^ n ->00.  We  claim  that  ^ as 

n -»  « . We  have 


s”(nt)viuj^nt^ 


l4“(t)  -sf(t)l.k-i/2  ■ z 


;’-Sj^(ntV'  .J^nt] 


^^k  - Pk.  ) 


!s^(nt:'-'  . nt]  I 
d -1/2  ^ V /J 

- n ).  (^,  - p^ 

^.=1  ^ 


< n 


-1/Z 


|pj^(n)nt-uj^ntl  ] + |S^(nt)-:  L.j^(n)nt]  I 


7, 

£=i 


V^k.-  • 


-1/2 


' luj^(n)nt-uj^nt|  ’ 


First  look  at 


By  hypothesis,  this  is  close  to 


|c.  I tl 


which,  by  Kolmogorov's  inequality  converges  to  zero  in  probability 
uniformly  on  0 < t < 1.  Now  renumber  the  sequence  and  consider 


lsjJ(nt)-uj^(n)ntl 


'ik-fk.'  • 


Since  ^ ^k’  term  to  converge  weakly  to  zero 

using  Proposition  2..  5. 


We  can  now  deal  with  instead  of  sf^.  This  is  helpful 

because  S,  is  independent  of  Let 

K 


= {1  < i < Klp^.  > 0} 


ik  ' . 


We  use  '3.  (tlV  to  denote  the  subvector  of  S^(t'  corresponding 
-^k 

to  indices  in  I,  . 3y  Proposition  r.".  for  k - 1,....K.  we  have 


k k 

where  are  independent  K dimensional  Brownian  motions  with  zero  drift 

vectors  and  covariance  matrices  1;^^, 


3-’ 


u ( 


'ki^kj 

i ,1. 

'ki'^-^kd 

i - J • 

It  should  be  clear  that  "=  0 if  either  i t or  o e 1^^. 

By  the  independence  of  and  we  have 


(4""’  ^ ^ in  as  n -» « , 


,K+1 


Vk  ^k’  ‘^k  xik 


for  1 < k < K.  The  converging  together  theorem  gives  us 


<<”.  sf)  ■>  ( h- 


as  n 


for  i ^ ^ £ K- 
Since 


x;;^nf: 


A^(nt)  + 7,  S^j^(nt)  - s”(nt) 


we  have 


A*-;t)  * X,(n'  ^ t ^ (t) 

- S*'';t'  - ^(n)  \/n  t . 


Using  the  independence  of  and  k = 1,  ...,K,  as 

well  as  the  independence  of  alj.  processes  v,ith  different  subscripts, 
we  obtain 


59 


from  the  continuous  mapping  theorem.  The  process  on  the  right  in 
(15'  is  equal  in  distribution  to  a K dim.ensional  Brownian  motion 


with  drift  vector  c and  covariance 


This  completes  the  proof 


[.i  . 

Corollary  1.  Under  the  hypotheses  of  Theore-n  1,  in 

as  n ->  00  . 

Proof.  By  the  definition  of  W,  p(W^,  < 2/^^  so  ->  0 

as  n ->  ».  Using  Proposition  2.1  we  have  the  result. 

Let  Z’**^(t)  = n Z^(nt)  for  n > 1 and  0 < t ^ 1.  and  let 

z*  = fCxx-). 

'/Srf  ' 

I 

Theorem  2.  Under  the  hypotheses  of  Theorem  1,  7/  in 

as  n -»  00. 

«n  i 

Proof.  Using  the  continuous  mapping  theorem,  we  get  f(w  ) ^ f'^X'*-^  : 

as  n ->oo.  The  continuity  of  f gives  ^(f , Z^'  * 0 as 

n -» 00  from  o(W  , X ) ^0  as  n — >oo.  Applying  Prooosition  2.1 

yields  the  result.  j 

I 

i 

j 


CHAPTER  U 


QUEl'EING  I\TrrW0RKS 

To  prove  the  limit  theorem  for  queueing  networks,  we  need  to 
construct  the  vector  queue  length  process  on  (O.^.P  . in  terms  of  the 
"equence  of  random  variables  defined  In  Section  j.l.  In  addition,  we 
will  require  several  modified  Queueing  networks  to  aid  in  the  proof. 

The  vector  queue  ’.ength  processes  of  the  modified  networks  are  also 
constructed  on  . The  standard  network  and  all  of  is  modifi- 

cation;- are  defined  in  this  chapter. 

‘.1.  The  Bororkov  Network 

The  queueing  network  we  introduce  in  this  section  is  closely 
related  to  the  modification  for  Gl/G  'S  queues  first  introduced  by 
Borovkov  '196b),  an!  is  called  the  Borovkov  network.  We  call  the  vector 
Queue  length  process  for  the  Borovkov  network  the  Borovkov  process. 

The  Borovkov  network  has  K stations,  each  of  which  functions 
as  a Bororkov  modified  single  serv'er  Queue.  The  process  Aj^  is  the 
input  process  to  station  k (k  = 1,...,K'  from  the  outside  of  the 
network,  so  Aj^'t'  denotes  the  number  of  customers  who  enter  station  k 
from  outside  of  the  network  during  O.f.  The  process  Sj^  is  the 
potential  service  process  for  station  k '^k  - 1,...,K).  As  long  as 
al'.  stations  are  busy  (nonemoty),  the  successive  potential  service 
tim.es  act  as  real  service  times.  When  a customer  arrives  to  an  empty 
station  he  departs  from  that  station  at  the  completion  of  the  potential 
service  ti-^e  in  progress  at  the  moment  of  his  arrival.  Potential  service 


1 


completions  at  an  empty  station  have  no  effect  on  the  Borovkov  process. 

A customer  who  leaves  station  k at  the  completion  of  the  potential 

service  time  v^  is  routed  to  the  station  indicated  by  rp^.  If 

= 0 then  the  customer  leaves  the  network. 

We  denote  the  subsequence  of  potential  service  times  at  station  k 

i. 

which  result  in  customer  departures  by  v,  ^ and  the  associated  routing 

indicators  by  Let  count  the  number  of  customer  departures 

from  station  k (l  < k < K)  during  '0,t].  In  addition,  let  S (t) 

jk 

denote  the  number  of  customers  routed  directly  from  station  j to 
station  k (l  < j,  k < K)  during  'Q.f.  We  then  have 


* 


Z 0 if  §.(t)  > 1 

i=l  J - 


if  S .(t)  = 0 , 

,V 


for  1 < j,  k < K and  t > 0.  Recall  that  $ . = e „ , where  e. 

is  the  K vector  with  one  in  the  ith  position  and  zeroes  everywhere 
else.  We  let  g = (g(t),  t > 0}  be  the  Borovkov  process,  so  we  have 


(1)  ^(t)  = Aj^f't'  + Z - Sj^(t)  for  1 1 k < K 


and  t > 0. 


Let  Aj^(t)  = Because  of  the  way  the  Borovkov 

network  operates  (iglehart  and  Whitt  (l970a))  we  have 


1 


(2)  ^(t)  = - Sj^(t)]  - inf  (\(s)  - Sj^(s)} 


for  i < k < K and  t > 0.  Thus 


(3)  \(t)  = Aj^(t)  - 5^(t)  - Sj^(t)  + ^ inf  - Sj^(s)} 


U.2.  The  Standard  Network 

The  standard  queueing  network  can  be  defined  on  (q, 
and  related  to  the  Borovkov  network.  The  vector  queue  length  process 
for  the  network  defined  here  is  distributionally  equivalent  to  that 
of  the  network  originally  defined  in  Section  1.2. 

Sach  of  the  K stations  of  the  standard  network  operates  as 
a standard  single  sejrver  queue  in  con,:‘unction  wdth  the  identically 
indexed  station  in  the  Borovkov  netv.-ork.  Thus  if  station  k (l  < k < K; 
in  the  standard  network  is  nonempty  at  the  completion  of  service, 
the  next  service  time  is  the  next  element  in  the  potential  service 
sequence  for  station  k.  When  a customer  arrives  to  station  k at  time 
t > 0 and  finds  it  empty,  his  service  time  is  the  next  unused  (by 
the  standard  network)  potential  service  time  occurring  after  t in 
S.  . To  make  this  verbal  description  precise,  let  N,  (t^  be  the  index 

IV 

of  the  last  potential  service  time  used  by  station  k in  the  standard 
network  by  time  t > 0.  The  index  of  the  potential  service- time  used 
to  serve  the  next  customer  at  station  k (who  begins  service  at  time  t) 
is  then  raax(Nj^!'t',  Sj^Ct'  1)  1.  This  procedure  clearly  yields  an 


i.l.d.  sequence.  The  routing  indicators  used  in  the  standard  network 


I 

i 


are  the  same  as  those  used  in  the  Borovkov  network.  The  1th  customer 

i. 

served  at  station  k in  the  standard  network  is  routed  by  cp  In 

& 

particular,  it  is  not  necessarily  true  that  the  index  of  the  routing 
indicator  used  for  a customer  in  the  standard  network  matches  the 
index  of  his  potential  service  time.  The  sequence  of  routing  indica- 
tors is  i.l.d.  and  independent  of  the  service  times.  The  arrival 
processes  from  outside  the  standard  network  are  the  same  as  those  for 
the  Borovkov  network. 

We  let  S,  (t)  denote  the  number  of  customers  served  at 
k 

station  k during  fO,t],  and  let  Sj^^. (t^  denote  the  number  of 
customers  routed  from  station  k to  station  j during  0,t^.  Defining 
g = {Q(t),  t > 01  as  the  vector  queue  length  process  for  the  standard 
network,  we  have 

K ^ 

\(t)  = Aj^(t'  + 7,  S^j^''t)  - Sj^(t)  for  1 < k ^ K and  t > 0. 

We  now  define  another  vector  process  associated  with  the 
standard  network  which  will  be  useful  in  the  proof  of  the  limit  theorem. 
Let  m(^,k, be  the  number  of  visits  to  station  k made  by  the  jth 
customer  arriving  to  station  i from  outside  the  network  for  1 < k,  ^ ^ K 
and  j > 1.  Then 


(m(j,k,^),  0 > 1^  1 < k,  £ < K , 


j 

I 

1 

I 

J 

J 

i 


are  mutually  independent  sequences  of  i.i.d.  random  variables.  Since 
the  seauence  of  stations  visited  by  a customer  forms  a Markov  chain 
(the  customer  is  absorbed  in  state  0 when  he  exits  the  network), 
m(j,k,£)  has  a geometric  distribution  with  E^ra(o.k.i)  ; = 

We  define  the  process  .N  = {N(t),  t > 0]  by 

K 

(5^  N (t'l  = Z Z m(j,k.i)  for  l<i<K  and  t>0  , 

^ k=l  j=l 


and  define  L = {L(t;,  t > 0}  by 


{6'l  L.(t)  = N (t)  - S (t)  for  1 < ^ < K and  t > 0. 

X/  a jL 


We  call  N,  the  total  load  process  for  station  I and  L„  the  load 
process  for  station  t. 

There  is  a relation  between  the  load  process  and  queue  length 
orocess.  We  have 


(7)  EiL,(t^|3f  : = Z Q (t)  R . for  i < i < K and  t>0 

X/  ^ .f_TO  O ^ 


from  which  we  get 


“1  1 m-f 

(8)  max  Q.(t)  > max  [K  max  R ] E.'L^(t}  i ] 


1<  j<K 


1".  i<K  l<j<K 


i 


4.5.  The  Input-Output  Network 

We  now  turn  to  the  Input-Output  (l/O)  network,  which  is  related 
to  both  the  Borovkov  and  standard  networks.  To  understand  how  this 
modification  works,  refer  to  Figure  5,  which  depicts  the  l/O  network 
for  the  two  station  case. 


FIGURE  5:  The  Input-Output  Network 

The  network  is  constructed  in  such  a manner  that  it  can  be 
viewed  as  K separate  Borovkov  modified  single  server  queues.  The 
input  processes  from  outside  the  network  are  again  (1  < k < K). 

In  addition,  station  k (l  < k < K)  receives  inputs  S for  1 < j <K 

~ ~ OK 

Thus  the  net  input  to  a station  in  the  I/O  network  is  equal  path  by- 
path to  the  net  input  for  the  identically  indexed  station  in  the 
standard  network.  Station  k (l  < k < K)  uses  as  its  potential 

service  process.  All  customers  completing  service  immediately  leave 

the  network.  Let  S’ (t)  denote  the  number  of  customers  served  at 

k 

station  k (l  < k < K)  during  '0,t^  in  the  I/O  network,  and  let 
Q^(t)  denote  the  number  of  customers  in  station  k at  time  t for  the 


l/O  network.  Then 


4? 


I 


Q^(t)  = A^(t)  + Z Sjj^(t)  - S^(t)  for  1 < k < 


K and  t > 0 


Since  each  station  operates  as  a Borovkov  modified  queue, 


we  have 


(10)  S’ (t)  = S.  (t)  + inf  (A:(t:i  - s (t)}  for  l<k<K  and  t > 0, 
* ^ 0<S<t 


where  A^^(t)  = Aj^(t)  + ^ for  l<k<K  and  t > 0.  Let 

d~L 


§K " <"ii’ ■ =iLk> 


Ik  -■  


for  1 < k < K , 


Ji  = K- 


for  1 < k < K , 


4k  ' k’  ~k 


for  1 < k < K , 


!,■  ' <il>  ■ jy  ' 


I ' (Ji’  -Jk' 


/ 1 2 N 

Sk  - (\-  • ■■ 


for  1 < k < K, 


rp  = (2;^,  ...  . rp^) 


I 


by  (lO)  and 


We  define  h(A,  S,  S,  cp)  = S' 

S^^(t)  = for  1 < .j,  k < K . 

Let  {0,1,,.. ,K}^  be  the  space  which  contains  the  entire  routing 
sequence  for  paths  of  the  random  ’valk,  endowed  with  the  discrete 

^ m,  V t,2X-+K  , „lKV0O 

topology.  Then  h:D  x {0,1, ...,K}  ->0  . When  viewed  as  a 

j.  j j.  j j.  _2K^+K  rr,T  VI  -4.  j 

map  restricted  to  C x {0,1,..,, K'  , h maps  into  C and 

is  continuous.  This  is  because  h is  constructed  with  composition 

of  continuous  functions,  which  are  again  continuous  '' 

It  is  helpful  at  this  juncture  to  point  out  the  relation  between 

the  Borovkov  network  and  I.O,  network  using  the  function  h.  From  (5) 

in  Section  U.l  we  have 

' 4 

(11)  S = h(A,  S,  S,  cp)  . 

An  important  point  to  note  is  that,  subject  to  = 0.  the  equation 

(11)  has  a unique  solution,  which  is  the  vector  process  for  the 
Borovkov  network. 

h.k.  The  Reflected  Random  Walk  and  the  Borovkov  Process 

We  again  consider  the  RRW  of  Section  5.2  and  show  that,  viewed 
on  a 'local'  level,  it  behaves  very  much  like  the  Borovkov  process. 

The  jump  times  of  both  processes  are  elements  of  J . The  only  difference 

I9 


_____  ^ 

, 

[■ 

i 

in  behavior  of  the  processes  occurs  when  one  or  both  encounter  a 
boundsiry.  At  jumps  associated  with  arrivals  the  processes  move  away 
from  the  boundaries  so  that  both  processes  always  change  by  the  same 
amo\int  for  surrivals.  Let 

/'Ng(t)  = g(t)  - g(t-)  , for  t > 0 , 

for  g C Then  if  t € a.U  we  have 

• A(Z(t)  - Q(t))  = 0 . 


Thus  we  only  need  to  deal  with  t t J . We  begin  by  splitting 
into  several  smaller  sets  according  to  the  relative  positions  of  the 
two  processes.  For  1 < k < K,  let 


and 


\ = {cTj^(-e)-.\(cTj^(-e)-)  = 0] 


We  then  construct  the  following  subsets 


of  fl/  ; 


(for  1 < k < K) 


(i) 

H 

11 

n f , 

k 

(ii) 

4- 

nf'  , 

(iii) 

Ji 

rpt 

'k 

nf^  , 

(iv) 

^k 

nf.  , 

(v) 

rnt’ 

k 

nf^  , 

(vi) 

4 

^k 

nf;  . 

V 

U J 

k=l 

k 

for  1 

6 

= U 
i=l 


. Let 


H(t^  = a(  E iQ.(t)  - Z.(t) I)  . 
•1=1  J ^ 


We  now  investigate  how  H(t;  behaves  on  each  of  the  six  sets  above. 

Assiime  t = a (i)  = cr(i')  = t(i")  and  = j.  Let 
n X 


and  define 


b]  (x) 


= h 

5/t)  - 

Z/tli 

X 

if 

z/t-) 

> Q^(t-) 

an  d X > 0 

or 

z/t-) 

> Q;(t-)-x 

and  X > 0 

-X 

if 

z/t-! 

< Q.(t) 

and  X < 0 

lx|-2bj 

or 

z/.t.) 

< 5^(t-)-x 

and  X > 0 

if 

5/t-' 

-X  < Z^(t-) 

< Q (t-)  and 
i 

X 

IV 

o 

or 

5/t-) 

< Z^(t-)  < Q^(t-)-x  and 

X < 0 

Let 


5^  (x) 


for  X ^ 0 


Then  s'"  (x)  < 1 for  x ^ 0. 


For  t £ 


k' 


A|^(t)  - Z^(t)  \ = 0 


and 


A!Q,(t)  - z.wi  = . 

- z^(t)|  . sJ'(-Pn^)  foi-  I ’ ;.X 


We  then  have 


E(A(Q_g(t)  - Z^(t)!  I )5  .(t-)  - Z ^(t-}!  > 1)  < 


This  is  obvious  when  [q  (t-)  - Z (t-)  | > 1 for  £ 3^  k since 
P{^j^  - O'  = Pj^^.  Let  = {-:  ^ k:l^^(t-;'  - 1 < 1}  , 

‘°k  " ^ Pkj 


k£ 


if  pj^>0 


"k£ 


if  pj^  p.  0 


for  / ^ Iq.  The  result  again  follows  by  a simple  calculation, 
we  have 


So 


r • . 


E(H(t)!3^^„_^,  |Q  i(t-)  - Z .(t-)|  > 1)  < 0 


o,. 


For  tej^, 


and 


Al\(t)  - Z^{t)\  = -1 

A|Q_g(t)  - Z^(t)l  = for  £ i k. 


Thus  H(t)  <0,  since  s^  ^ki  - *• 


For  t G let  5 = \(^-).-  "then 


and 


Then 


A|0.^^(t)  - Zj^(t)|  = - 5 , 


a|Q  (t)  - Z.(t)'  = sV(l  - '1-6]P./  , 

Jo  V 


A|Q^(t)  - Z^(t)i  = s^  (-  '--&]Pj^^)  for  £.  4 j,k. 


E(H(t)|35..,_^,  [5  .(t-)  - Z .:t-M  > 1)  = - [1  . Z ij'p  1 < 


■'k 


i=I 


by  simple  calculation.  We  will  need  a sharper  result.  If  p > 0 

KU 

then 


E(H(t)!^^,._^,  .(t-)  - z .(t-;!  > 1)  < . 
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regardless  of  the  values  of  s for  1 < i < K.  If  p = 0 and 

Xt  “ ""  iCU 

s^  =1  for  > 0}  then  H(t)  = 0,  while 


E(H(t)  IQ  ^(t-)  - Z ^(t-)|  > 1 some  i 5^  k) 


min  p,  5 . 
|p^>01 


For  t t J let  5 = Zj^(t-),  then 


.|^(t)  - 2^(t)|  = -(1^) 


A|Q/t)  - Z^(t)i  = i ^ , 


so  that  H(t)  < 0. 

For  t > 


A|0^(t) 

A|Q.(t) 

«J 


A'5^(t) 


Z^(t) 


Z,(t)|  . s‘'(l)  , 


Z/t)| 


= 0 for  H,  / j,  k. 


so  that  H(t)  <"  0 . 


For  t G both  processes  a’^e  on  the  interior  and  so 


H(t)  = 0. 


CHAPTER  5 


THE  LIMIT  THEOREM 


In  this  chapter  we  prove  a limit  theorem  for  a sequence  of 
standard  queueing  networks,  as  defined  in  Section  The  modified 

networks  defined  in  Chapter  ii  play  an  importajit  role  in  the  proof. 


5.1,  Statement  of  the  Limit  Theorem 

We  assume,  as  in  Section  3.5,  that  we  have  an  appropriately 
defined  sequence  of  probability  spaces  { n > 1}.  In 
the  same  way  that  we  constructed  g.  and  g'  on  ( 1.  ^.P)  in 
Chapter  4,  we  construct  ^ 4',  ^ 1)  > ■ n > 1}  on 

{(o",  n > 1]. 

The  heavy  traffic  theory,  as  explained  in  Chapter  1,  deals  with 
systems  near  saturation.  Our  definition  of  heavy  traffic  is  essentially 
that  used  by  Iglehart  and  Whitt  (n70a,b;  properly  adapted  to  the  mere 
complicated  setting  of  general  networks.  For  our  limit  theorem  we 
require  that  -»  1 as  n -»<»  for  each  station  i,  and  that  further- 
more (v^(n)  - nj^(n))  \/n  -♦  n -»»,  with  -op  < c^  < » for  each  i. 

This  last  requirement  essentially  says  that  the  traffic  intensities 
at  the  various  stations  approach  unity  at  comparable  rates.  We  may  have 
_>  1 from  below  for  .some  stations  i,  -»  1 from  above  for  other 
stations  j,  and  = 4 still  other  stations  k. 


Let 


(1^ 


^^(t)  = Q^(nt)  for  ^ t < 1 and  n > 1. 


The  following  is  the  main  result  of  this  dissertation. 


Theorem  Suppose 


i) 

Uk(n)  -»uj^ 

as 

n — » 00 

for 

k 

= I,. 

. . , K, 

ii) 

as 

n 00 

for 

k 

II 

..,K. 

iii) 

\{n) 

as 

n -» 00 

for 

k 

= T 
— ^ • 

..,K, 

iv) 

s.^(n)  ^ Sj^ 

as 

n -» 00 

for 

k 

= 1, . 

. . .K. 

V) 

(vj^(n)  - uj, 

(n)) 

y/n  c 

, 

< 

V 

o 

00.  for 

vi)  nsLx 

1<  k < K n>l 


sup  S{  (v^(n)  < 00  for  some  <"  > 0 , 

iC 


vii)  max  sup  E{(u.  (n))‘  } < oo  for  some 

1<  k <K  n>i 


€ > 0 . 


^ * K * 

Then  Q Z in  D as  n -»  oo,  where  Z is  the  -process 

defined  in  Chapter  5. 

Proof.  The  proof  has  several  stages,  which  are  taken  up  in  the  next 
two  sections. 


gw 


We  first  show  that  the  normalized  difference  between  the 


Borovkov  process  and  the  RRW  converges  weakly  to  zero.  Let 
(2)  ^‘^(nt)  for  0 < t < 1 and  n > i. 


Proposition  1.  Under  the  hypotheses  of  Theorem  3,  o(Q  . Z ' ==>  0 


as  n -» ». 


Proof.  We  first  need  to  slightly  modify  the  notation  of  Section 
Let 

T^(n,t)  = = 0} 


for  n>l  and  t > 0.  Similarly  define  T'(n,t),  T'''n,t),  f (n.t). 


f^(n,t),  af  (n,t),  and  J"~{n,t)  for  1 < i < ( . Let 


(3) 


and 


to  show 


K 


D'^(t)  = Z |g"(t)  - Z^‘(t) 
k=l 


•1 

n ' D (nt).  By  the  triangle  inequality  it  will  suffice 


sup  D (t)  -.r>  0 as  n -»  ». 
0 < t<  1 


Using  the  definition  of  H(t)  frcm  Section  we  have 

D”(t)  = Z , 

j^(n,t) 
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where  for  ease  of  notation  we  set 


i 

I 

f 

f 

i! 

f 

I 

i 


i 

[ 

t 

I 

( 


; 

i 


h F.  . (•)=!:  (•)  . 

£ (n,t) 

We  use  the  same  notational  convention  for  other  sets  as  well. 
The  index  of  summation  will  almys  be  obvious  from  the  context. 

By  the  discussion  of  Section  4.4, 

6 

(5)  D”(t)  = E . E . 

i=l  /^(n,t) 

We  can  immediately  dispense  with  r.  jt  j ^ and  ^ ' since  for 
these  sets  H(t)  < 0. 

We  deal  first  with  t 1 Since  every  epoch  in  results 

in  an  increase  of  one  unit  in  we  have 

(6)  I J^(n,t)|  < 'T^(n,t}  ! < Y5J(t'  . 


where  | • j applied  to  a set  gives  the  cardinality.  We  denote  the  sub- 
sequence of  in  >«/^'n,t)  by  and  the  corresponding  index 

in  jJ  by  i' . Then 


'7) 


We  need  to  further  subdivide  J .{n,V  . Let 


5« 


ILi 


i 


and  ^^(n,t)  = J^(n,t)\  J^(n,t) . For  ^ J k’ 

i* 

Sj  (‘I’v  • “ Pv-)  form  a supennartingale  difference  sequence.  From  the 

J KT 

proof  of  Proposition  5.1, 


:^(t)  < [^(t)R]  - E M^(t)R,,  , 

^ ^ J=1 


where 


M“(t)  - - inf  Oc"{t)} 
“ 0<  s < t 


^n  * 

Theorem  1,  5i  X , so  we  can  apply  Proposition  2.5  to  give 


(9)  P{  sup  E H”(t,)  > Vne]  ^0 

0<t<l  |^^(n,nt) 


as  n -♦  00, 


for  all  € > 0.  For  we  know  that 


so  that 


(10'  sup  _ E H(t  ) < ?. 

0<t<l  ^^(n.nt) 

With  the  normalization,  this  piece  converges  to  zero. 
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-5^,  + Z < 

•1  1 


from  Section  U. U and  we  can  use  Proposition  P.5  as  above  to  get 


(12)  P{  sup  /'  Z H(t.)  > V^s)  ->  0 as  n -» 00  for  all  ? > 0. 

0<t^l  ^ 

>N 

The  only  bound  we  have  for  Tj^tnit'  is 


(13) 


lT:(n,t)!  < S^(t)  . 


Coupling  the  fact  that  n ^S?(nt^  --•■->  a,  t as  n oo  for 

K K 

1 < k < K and  0 < t < 1 with 


(iM 


K i.  _ , 

E[-5_^,  + Z s^  ^ ^ ^ 


< -26  min{pj^^|i  < ^ < K and  p^^^  > 01  , 


we  can  use  Proposition  2.6  to  get 


(15)  P{  sup  A Z H(t , ) > e)  ->0  as  n -»  » for  all  e > 0 

0<t<l  T;(n,nt) 

k 


Combining  (9),  (10),  (12)  and  (15'  yields  the  result. 


5.5.  The  Borovkov  Process  and  the  Standard  Network 


' In  order  to  show  that  the  normalized  difference  between  the 

standard  and  BorovJcov  networks  converge  weakly  to  zero,  we  use  the  l/O 
network  as  an  intermediate  step.  We  start  with  the  easier  part  which 
^ deals  with  the  standard  network  and  l/O  network.  Let 

, g''^’^(t)  = g'’^‘(nt)  for  0 < t < 1 and  n > 1 . 

Proposition  2.  Under  the  hypotheses  of  Theorem  5, 
as  n -» 00 . 

Proof.  By  construction,  each  station  in  the  I/O  network  has  the  same 
input  as  the  identically  indexed  station  in  the  standard  network. 

Thus  we  can  use  Theorem  5.1  of  Iglehart  and  Whitt  ( 1970a)  which  says 
that  for  single  station  systems,  the  normalized  difference  between 
the  Borovkov  and  standard  systems  converges  weakly  to  zero.  This 
gives  us  ^0  as  n -400  for  1 < k < K.  The  triangle 

inequality  yields  the  result. 

Before  proving  the  other  part,  involving  the  1^0  network  and 

r Borovkov  network,  we  present  two  lemmas  which  are  needed  in  the  proof. 

} 

Let 

(12)  l^”(t)  = n"^'^^(W^(nt)  - r^(n)nt’  for  1 < ^ < K,  0 < t < 1 

and  n > I. 
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Lemma  1.  Under  the  hypotheses  of  Theorem  3,  =?■  ^ ^ for  1 < / < K, 

where  'is ^ is  Brownian  Motion  with  zero  drift  and  variance 


^ v^). 


A^(t) 


Proof.  Let  N^(t,k)  = T,  m(j,k,i)  for  1 < ;g,  k < K,  t > 0,  and  n > 1, 


I^^(t,k)  = n‘^/^^N^(nt,k)-Xj^(n)Rj^_,ntl  for 


for  1 I,  k < K.  0 < t < 1,  and  n > 1. 


r A,  nt  ] 
• k 


N^"(t,k)  = n'^/^  Z (m(l,k,^)  - 


for  1 < k < K,  0 ^ t < 1,  and  n > 1, 


^”(t,k) 


A^'Cnt) 


n"^^^  E (m(j,k,i.)-R,  J 
0=1 


for  l<i,  k<K,  0£t<l,  and  n > 1. 


In  order  to  get  m(o,k,  £)  to  be  independent  of  n,.  we  work  with  a 
distributionally  equivalent  standard  network  where  each  customer 
carries  his  own  sequence  of  routing  decisions.  Thus  the  we 

deal  with  here  has  the  same  measure  as  that  of  the  standard  network 
defined  in  Section  h.2. 

By  Proposition  2.3, 


^ in  D for  l<i,  k<K, 

where  * ' • ’ independent  Brownian  motions  with  zero  drift 

and  variances  (When  = 0,  is  identically  zero.' 


We  have 


l5j''(t,k)  = N^(t,k)  + . 


Let  N*'(t,k)  - ^^(t,k)  + P.  then 


^ Vk^'^  ■"  ^ l<f,  k<K. 


/ \ 

By  the  same  argument  used  to  show  o'S  , 0 in  Theorem  1, 

we  get  o(f^(’,k),  if^(*,k))  =>  0 for  1 < 2,  k < K.  3y  the  converging 
together  theorem, 


Nf'(-,k)  ^ in  D for  1 < £,  k £ K. 


3y  independence  of  the  components, 


This  comoletes  the  nroof. 


s^(t)  = n"^^^[s“(nt)  - ^J^(n)nt] 


for  1 < k < K and  0 < t < 1, 


^"(t)  = (nt)  - Pj^^.uj^(n)nt]  for  1 < j,k  < K and  0 < t < 1, 


~ ’ \V  •'•  ’ kK^  • 


L«»mnia  ?.  The  sequence  n > is  tight  for  1 < k < K. 


Remark.  Tightness  is  a condition  on  a sequence  of  stochastic  processes 
which  guarantees  that  every  subsequence  has  a further  subsequence  with 
a weak  limit.  Conversely,  any  sequence  of  stochastic  processes  which 
converges  weakly  is  tight.  (See  Billingsley  (I968) , Theorems  6.1  and 
6.2.) 


Proof.  By  the  definition  of  tightness,  we  need  to  show  that  for  all 
e,  q > 0,  there  exists  a 6 6 (0,l)  and  an  n^  > 0 such  that  for 
n > Hq, 

P{  sup  (|s*''(u)-s^(t)!  + i:  |Bf“(u}-S^(t)l)  >e}  <q  . 

Without  loss  of  generality,  we  will  henceforth  assume  that 
u > t.  We  know  that  n > 1}  is  tight,  since  it  converges  weakly. 

By  definition  of  we  have 

(15)  sj"(nu)  - sJJ(nt)  < sU(nu  + e^(nn))  - s|J(nt  + 9°(nt)), 


I 


■where  sP  is  the  shift  operator  which  lines  up  the  service  process 
for  the  kth  station  of  the  standard  system  with  S^.  'See  Iglehart 
and  Whitt  (l970a).  Theorem  3.1  for  a complete  description  of  the 
shift.)  From  Iglehart  and  Whitt  (l970a),  we  know  that 

(16)  P{  sup  isJJ(nu'-S^(nt)-S^(nu  + eJ(nu))+s"(nt-fl^(nt^)!  > n 

0 < u,  t < 1 

Thus 

(17)  P{  sup  s“(nu)  - s”(nt)  - u^(n)  n(u-t)  > < n . 

!u-tl<5 


To  get  the  bound  on  the  other  side,  we  use  the  load  process 
N.  We  have 

(18)  S^(nu)  - S”(nt)  = (Njj(nu)  - Nj(nt))  - ;Lj(nu)  - L^(nt)]  . 

By  Lemma  1,  n > 1)  is  tight,  so 


(19)  P{  sup  iNp(nu)  - N^(nt)  - rj^n(u-t)!  >-^'—7^ — ) < h 

lu-tl<  6 

and 

(20)  sup  In. '^(nu^  - N °(nt>  - n^u-t'  | > < 7 

'|u-tk5'^  k K - - 

since  (rP  - uP)  -*  (cR),  . We  want  to  show  that 
P{sup  L^(nu)  - L|^(nt)  > eA}  < ’i-  This  is  done  via  the  queue 
length  process.  We  claim  that  for  any  f',  >0  there  exists  a 

5^  > 0 and  nj^  > 0 such  that  for  n > n^, 
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(21) 


P(  sup  Q^(nu)  - i^(nt)  > y/ii  e']  < ’l' 
u-t  I <5  ~ 


Since  Q^(*)  > c£in  assure  without  loss  of  generality  that 

Q^(nt)  = 0 and  that  Q^(ns)  > 0 for  t < s < u.  We  then  have 


^(nu)  < [A^(nu)-A^(nt)  ] + T.  fs"  (nu  + 0"(nu);  - S^^(nt  + 0"(nt)) 


J=1 


- [S^(nu  + e|^(nu))  - 5^(nt))"  , 


The  tightness  of  n > 1] , n > 1)  and  {S^,  n > 1] 

give  the  result  (21) . 

From  equation  we  know  that 


max  [K  max  E[L^(t)|^”]  < max  Q?(t)  . 

l<i<K  1<G<K  ^ ^ Kj^  ^ 


Let 


^6 


min  bi  and  n)!  = max  n,  , then 
l<k<K  k -0  V 


P{  sup  E^L^(nu)l^'^  " 
|u-tl<5’  ■ ' 


> e' } > 


Let  q'  = 1^/2.  We  work  on  the  set 


{ sup  E:L"(nu)|‘^>"  j - E[L’^(nt)  j . 

|u-t!<6’  ^ i ' nt 


on  which 
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P[  sup  L^(nu)  - L°(nt)  > e/c}  < '-ic'/e  ■*•  'h/S 
|u-t|<6  ^ 

by  a simple  Chebychev  type  inequality.  Choosing  e'  = ’lc/8,  gives 


the  |s^”(u)  -i^”(t)(  part. 

To  show  P{  sup  > €/2K]  < r^  , 

|u-tl<5  ^ 

we  work  on  the  set 

{ sun  |S^(u)  - S’^(t)l  < e";  , 

|u-tl<5 


<hich  has  probability  measure  at  least  (l  - ’-|/2).  Using  Kolmogorov's 
inequality, 


Then  we  have 


<3 


+ inf  [kf^is)  - + c "s 


0 < s <t 


Just  as  in  Section  ^.5,  we  can  write 


S - ’ a , S , 


I*"  = hjA*”,  f”,  ^,-f)  . 


with  S uniquely  defined  subject  tc  S ^(0)  - 0.  From  Lenrn  t.l 

— > 

of  Iglehart  and  Whitt  (l970a)  we  have  o(S  ' ^0  as  n -> » 

A }C 

for  1 < k < K.  The  inequality 


iSf^'Ct)  - s;*"(t)l  < i^(t)  - 


gives  o(^,  S^)  ri>0  as  n -»»  for  1 < j,  k < K.  So 


1>„(A*°,  t".  OJ!  -.0 


as  n 00 


By  the  tightness  of  f S , h > 11  ve  can  take  a subsequence 
'^n'  #n  ^ 

n*  such  that  ET  s,  and  hence  S'  S . By  the  continuous 
mapping  theorem. 


b„(A*“,  f”. 


, S , S . ? ) 


S by  the  argument  above^  so  the  limit  is  unique.  Since 


+ c^t 

is  a continuous  function  of  its  data, 

-^0  as  n -4®  , 

Combining  Propositions  5 and  €■  wc  get  ^ 0 as  n ->  00, 

so  that  Theorem  3 follows  from  Theorem  2 and  an  application  of  the 
converging  together  theorem. 
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CHAPTER  6 


PRDPERTIES  OF  THE  LIMIT  PROCESS 

This  chapter  is  devoted  to  a discussion  of  the  limit  process 
Z . We  begin  by  relating  the  definition  of  Z given  in  section  1.1 
to  the  analytic  theory  of  Markov  processes.  In  the  second  section, 
we  derive  a partial  differential  equation  which  must  be  satisfied  by 
the  stationary  distribution  (if  one  exists).  In  Section  J we  present 
a family  of  special  cases  for  which  we  have  solved  the  partial  differ- 
ential equation,  and  in  Section  1 we  show  that  Kobayashi's  stationary 
distribution  solves  the  partial  differential  equation  for  a subset 
of  these  cases. 


6.1.  The  Limit  Process  is  a Diffusion 

Multidimensional  diffusions  with  boundaries  have  previously 

been  studied  by  Bellot  (1975),  Stroock  and  Varadhan  (1^1),  Watanabe 

(1971),  and  several  other  authors.  Their  work  does  not  cover  oiu'  limit 
* 

diffusion  Z . Bellot  (1975)  considers  only  the  case  of  normal 
reflection  in  two  dimensional  regions,  while  Stroock  and  Varadhan 
(19T1)  and  Watanabe  (1971)  impose  smoothness  restrictions  on  the 
boundaries  which  are  not  satisfied  in  our  case.  The  following 
definition  of  a diffusion  is  broad  enough  to  cover  our  process,  however. 
It  is  due  to  Ito  and  McKean  (1965). 
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Definition.  A stochastic  process  W = {W(t),  t > 0}  is  a diffusion  if 
i)  it  satisfies  P{W(T  + s)  € A\jf^]  = PfW(T  + s)  c Alw^T)} 
for  A € where  is  the  a-field  generated  by 

{W(s),  0 < s < t},  T is  any  stopping  time,  and  s > 0,  and 

^(YT 

ii)  R^tg(*)  -»E  [/  e g(W(t) )dt]  maps  bounded  continuous  functions 

• 0 

into  bounded  continuous  functions. 

Condition  (i)  is  the  strong  Markov  property  and  (ii)  is  a kind 
of  regularity  which  implies  continuity  of  paths. 

Remark.  If  X (O)  £ then  Z (O)  = X (O).  Thus  the  notation 

P^(-)  can  be  interpreted  as  the  probability  measure  on  the  path  space 

of  Z corresponding  either  to  X (o)  = x or  Z (0)  = x,  when  x ' 

, ♦ 

To  have  “lake  sense  we  need  to  show  that  Z is  a Markov  process. 

This  will  be  a result  of  i),  so  that  after  it  is  proven  we  are  ^justified 

in  our  use  of  this  notation. 

* 

Proposition  1.  Z is  a diffusion. 

Proof.  We  verify  (•)  using  the  relation  between  Z and  X . and 
the  strong  Markov  property  for  X . Note  that  (i)  is  equivalent  to 


P{Z*(T+s)  -Z*(T)!j>^1  = P{Z*(T+s'  - Z*(T' 'z’^'t))  . 


The  term  [X  (T+s)  - X (T)]  is  independent  of  by  the  strong 

Markov  property  and  independent  increments.  The  term  [y(T+8)  - Y(T)’ 
is  independent  of  the  past  conditioned  on  Z (T)  by  the  definition  of  Y. 

To  verify  (ii)  we  again  use  the  relation  between  Z and  X . 

Let  g;]R^  be  bounded  and  continuous,  and  let 


h(x)  = Ro«(x)  = E [f  e"*^  g(Z*(t))dt] 


for  X € IR^.  For  purposes  of  this  proof  only,  we  introduce  the 

■H*  -)(■ 

notation  X and  Z to  correspond  to  the  processes  starting  at 

K * 

X £ IR^.  Since  a shift  in  the  starting  state  of  X shifts  the  entire 

path  of  the  process  by  the  same  amount,  if  ’x-x'  ! < '"■,  then 


sup  l£(t)  - X*,(t)l  < 6 . 
0<t<® 


K K ^ ^ 

By  the  continuity  of  fjC  _» C which  defines  Z in  terms  of  X , 

for  any  e > 0 there  exists  a 6 > 0 such  that  if  Ix-x'  j < 5,  then 


sup  'Z^(t)  - Z*, (t) I < e . 
0<t<» 


The  continuity  of  g implies  that  for  any  n > 0,  there  exists  sm 


t > 0 such  that  if  |x-x’ | < then 


sup  !g(Z  (t))  - g(Z  ,(t)' ! < n 
0<t<» 


Thus  |h(x)  - h(x’ ) I < n/a  and  so  h is  continuous.  The  bounded 
part  is  obvious  from  boundedness  of  g. 
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In  order  fo  describe  Z In  terms  of  its  generator  we  need 

to  Introduce  some  notions  from  the  analytic  theory  of  Markov  processes. 

In  defining  the  weak  Infinitesimal  generator  we  follow  Oynkin  (1965) 

* K 

specializing  his  treatment  for  general  state  spaces  to  Most  of 

the  information  pertaining  to  Markov  processes  in  Ekiclidean  state  spaces 
is  also  contained  in  Breiman  (1968).  Let  3 be  the  set  of  all  bounded 
and  measurable  functions  from  E into  E,  and  define 


T...g(ci;)  = E [g(Z  (t))]  for  g £ B.  x € E*:  and  t > 0 . 

Also,  let  B^  be  the  subset  of  B for  which  T g g as  t i 0,  and 
let  & be  the  subset  of  for  which  ''T^g  - g)  /t  converges  boundedly 

pointwise  to  a limit  in  B^,  We  denote  the  limit  by  ar.d  the 

operator  M is  called  the  (weak  infinitesimal)  generator  of  Z . 

The  set  is  called  the  domain  of  the  generator. 

Remark.  Bounded  pointwise  convergence  is  pointwise  convergence  with 
the  added  condition  that 

t ^ sup  vl  ('T*.?)  (^)  “ g(’^)  ! < M < 00  for  all  t small  enough. 

— •«r>  Iv 

X t E . 


(See  Breiman  (1968'',  p.  ?^.)  The  type  of  convergence  used  by  Dynkin 
(1965)  is  weak  convergence  for  linear  functionals  on  the  Banach  space 

f 

consisting  of  all  real,  bounded,  measurable  functions  on  the  state 
space.  When  the  state  space  Is  Euclidean,  this  specializes  to  bounded 
pointwise  convergence. 


-i  IR  vanishes  in  some  neighborhood  of 


We  say  that  gi® 


and  X,  + X.  < e then 


->  ® which  vanish  in  some  neighborhood 


of  every  corner  and  have  bounded  derivatives  of  all  orders.  We  intro 


duce  the  notational  convention  x 


ith  component  of  x € ® is  replaced  by  zero 


Preposition  2.  Suppose  h £ 


in  which  case 


so  that  if 


0 boundedly  point-wise  as  t -I  0 for  x £ ® 


By  Taylor' s theorem 


> 


X. 

1 


We  begin  by  considering  x lying  on  one  boundary,  so  that 
/ * 

=0,  Xj  > 0 for  j / i.  Until  Z hits  another  boundary, 

Y.(t)  =M^(t)  = - inf  {X^(s)},  and  Y.(t)  =0  for  J i.  Let 
^ ' 0<s<t  ^ 

/V 

= (Z(t),  t > 0}  be  the  process  defined  by 

= X*  + Mjt) 

(U)  and  ^ 

Z.(t)  =X.{t)  (t)  +x.  for  j ^ i. 


Let 


Hi 


1 i = a 


■°ii 


i i 


then  Z^(t)  = X^(t)  + q. ^M^(t)  for  1 < i < K.  Using  the  fact  that 
h vanishes  in  every  corner,  as  well  as  the  first  exit  distribution 
for  multidimensional  Brownian  motion  (ito  and  McKean  ■'’196^'  , p.  c’3^ 
we  have  |e  h(Z  (t))  - E h(Z(t))l  = o(t) . So  ve  compute  the  generator 

X ^ X 

/s 

for  Z.  We  have 


(5) 


where 


(T^^h)(x)  - h(x) 

K A K K 

- t h (x)  E^f.tZ  (t)]  + 2 2 h (x^  E f..NZ  (t^tZ^(t)’ +6(t) 

i=;l  i=l  k=l 


AZ^(t)  = Z^(t)  - Z^(0),  and  the  c't'  is  bounded  using  bounds 


on  the  third  moment  of  Brownian  motion.  Let 


M (t)  = sup  fX^(t)^ 
0<s<t  * 


From  known  results  on  Brownian  motion, 


t E [M.  (t)j  -»oo  as  t 1 0 and  t ^ E [M,  (t)]  -> » as  +40 

XI  X i 


t”^  E [M?(t)j  O'?  as  t A 0 and  t"^  E [M?(t)1  a?  as  t 4 0, 

XI  1 X 1 1 ' 


t"^  E^[X*(t)]  -»c^  as  t 4 0 and  t"“  E^:x^(t)  X^(t)  ] as  t4 


Using  (5),  the  definition  of  Z and  (6)-'^';, 


(T^h)(x)  - h(x) 


= Z h,(x)  c t + E[M  (t)]  Z h (x)  q 
K K 

+ Z Z h^j^(x)  E^^(xJ(t)  +q,^M.(t))(X^(t}  +q.j^K.(t}}^ -S^t), 


We  have 


" %Ak=x-«i<‘''  • 


I 

t 


It  is  knovn  that  Xj^(t)  + (t)  has  the  same  distribution  as  M^(t) 
for  all  t > 0 (see  the  proof  of  Proposition  3 in  Harrison  (l97?))- 
Thus 


E^[(X*(t))^  + 2X*(t)K^(t)  + M^(t)]  = E^[M?(t;] 


E [x'!(t)M,(t)]  = E^X,(t)(M  (t'  - X (t))]  for  j ^ i. 

X , I i X , X X 


Using  (8)  and  (11), 

t"-  3^:x'^(t)  M,_(t): 


- i as  t i 0. 


By  symmetry. 


riU)  E^((x.(t) 

X J 


- c.t)  inf  {X.  (x)-c. s) "! 

i i'' 


0 < s < t 


=E  [(X  (t)  - c t)  sup  {X  (s 
^ 0<s<t 


= ,3]] 


We  have 


* 

sup  {X  (s)  - C SJ  - 
0<s<t 

'c.  !t 

< 

sup  {X*(3)} 

< 

sup 

X 

0<s<t 

0<  s<t 

inf  (X  (s'*  - s)  - 

!c.  It 

< 

inf  CX^(s)} 

< 

inf 

0^s<t  ^ 

1 

0 < s < t 

0<s  <t 

M (t)  = sup  {X.(s)  - c s]  + c.s’ 
^ 0<s<t  111 


M.  (t)  = - inf  {X  (s)  - c s}  - c s" 
^ 0<5<t 


for  some  s',  s"  with  -t  < s',  s"  < t.  Substituting  this  into  (l^) 
E [-(X*(t)-c  t)(M. (t)  + c s")]  = E [ (X*(t)-c  t) (M  (tt-c  s' )] 

Xjjl  1 Xjjli 


(15^  E^:X*(t)M.(t)]  + E^[X*(t)M.(t)] 

= c^t  E^[M.(t)]  + V^ts"  - c.s"  Ex:x^(t)] 


+ c.t  E [M,(t)]  - c.c.ts'  - c.s'  E ^X  (t)l 
j X i ^ j ^ ^ 


Combining  (12)  and  (15), 


■ E^fX*(t)  M^(t)]  = - I E^[X*(t)  X.(t) 1 + o(t) 


Substituting  (15)  (l6)  into  (lO), 


(17)  t"^  ^ ^ 


2 hla^n  ^ ^ *^i.«^ki  %^'^ik'^ii 


Thus  for  the  second  order  terms  we  have 


K Y 

(18)  Z E^!(X*(t  + ^ 

S/—\.  k“l 


K K 


= Z Z h,,  (x’ 


V 

_2  , V 


A A ^ 


’*5  ^ ’’ik'ii 


Since  t”^  S^[M^(t)j  -» <»>  as  * * 0.  froE  ^9)  we  see  that  (T^hfx)-h(x)  )/t 

-•K  / 

can  stay  bounded  only  if  q.  . =0.  Ass'jne  that  this  is  true. 

t."~  ^ c ^0 

Then  using  (9)  f-ni  (l8) 


t"“[T^h(x)-h(x)] 


X K ^ 

h,(x;c.  ^ Z Z h (x)  c;  , 

^ c 411-^ 

vl=-  X-i 


boundedly  pointwise  for  x on  one  boundary'. 

If  X lies  on  more  than  one  boundary,  that  is,  x^  = 0 and 

X.  = 0 with  i 4 J,  then  E :h(Z  (t'}.''  = o{t)  from  the  first  exit 
J X 

* 

distribution  for  X , since  h vanishes  in  every  corner. 

V 

Now  we  deal  with  X on  the  interior  of  P.‘‘  so  that  x.  > 0 

+'  1 

for  1 £ 1 £ X.  We  first  show  pointwise  convergence  of 

(T^h(x)  - h(x')/t  as  t i 0 and  then  show  that  this  is,  uniformly 

•V- 

boijnded  on  the  interior  for  small  enough  t.  Until  Z first  hits 

V- 

a boundary  it  behaves  path  by  path  like  X , so  that 


|E^  h(Z  (t))  - E^h(X  (t)}!  - o(t) 


from  the  first  exit  distribution  for  X . Thus 

'V-'*)  - -i  Z ofj  (x)  * Z^  (x)  M t » 0 


ao 


K 

for  X on  the  interior  of  since  the  expression  on  the  right  is 

the  generator  for  X on  ^ (ito  (196I),  Section  3.2). 

To  complete  the  proof,  we  show  that 


t~^"  sup  j.  [T  h(x)  - h(x)  ! < T < » . 


xGF. 


We  have  alreadj'-  shown  this  for  boundary  points,  and  so  we  only  deal 
with  interior  points.  Using  Taylor’s  theorem, 


t~^[T  h(x)  - h(x)] 
K 

V 

i=l 


= t~^^[  E h^(x)E^LAZ*(t)  ] 


K K 


Z Z h ,(x)E  (t)AZ.(t)]  + 8(t)], 

i=l  j=l 


where  the  o(t)  term  is  due  to  the  uniform  bound  on  the  third  derivatives 
of  h and  bounds  on  third  moments  of  Brownian  notion  and  third  moments 
of  the  maximum  of  Brownian  motion.  We  can  bound  the  .second  order 
terms  using  the  calculation  above  for  the  generator  at  a point  lying  on 
one  boundary.  So  only  the  first  order  terms  remain. 

We  divide  the  interior  of  into  K+1  (non-diSiioint)  sets, 

and  deal  with  each  one  individually.  For  1 < k < K,  the  ’.rth  set  contains 


t 


Now  consider  a point  x in  the  hth  set  for  1 < k < K.  If 

In  addition  x is  in  the  jth  set  for  i ^ k then  < e/2. 

* * 
Then  (t))  = o(t)  using  the  first  exit  distribution  for  X 

and  the  fact  that  h vanishes  in  every  corner.  For  these  points 

(T.h(x)  - h(x))/t  is  therefore  bounded.  We  are  left  with  points  in 

the  kth  set  which  are  not  in  any  of  the  others,  so  that  < e/ii 

and  X.  > for  j / k.  We  have  |E  (.-^^Ct))  - E (.lZ(t))|  = S(t} 

J XX 

■¥r 

for  these  points  using  the  first  exit  distribution  for  X , where 
Z^it)  = X*(t)  + 1 ^ < K and  t > 0 . 


In  this  suffices  to  show 


t"^  E^[Mj^(t)f 


Z h (x)q  + t"^  Z h (x)  E 'X*(t)] 
j=l  ^ G=1  ^ 


is  uniformly  bounded  in  x for  small  enough  t.  We  can  immediately 
dispense  w5.th  the  second  term  since  it  is  clearly  bounded.  Using 
Taylor's  theorem, 

K K . * 

Z h^(x)q  = Z h (x^'q  + sup„  max  !h  (x)|x 

J=1  j-1  ^ 

with  jx*|  < Ixl.  Since  Z^_,  h (x^)q  . =0  and  sup  max  |h  (x)| 

is  finite,  we  need  (|xl  E^^Mj^(t)  l'^)/t  bounded  in  x for  small  enough  t, 
»*ich  follows  easily  from  the  first  passage  and  maximum  distributions 
for  Brownian  motion.  This  completes  the  proof. 


I 


i 


i 

1 


( 

i 

j 


i 
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We  now  have  a .justification  for  calling  Z a diffusion  with 

* 

reflection  direction  e^ -p^  at  the  boundary  corresponding  to  = 0. 
According  to  Watanabe  (197I),  the  restrictions  on  the  domain  of  the 
generator  given  by  (2)  define  the  angle  of  reflection.  Specifically 
when  a restriction  on  the  domain  takes  the  form  that  a particular 
directional  derivative  at  a boundary  point  must  be  zero,  then  the  process 
reflects  in  this  direction  at  that  boundary  point. 


6.2.  The  Stationary  Distribution 


We  now  derive  a partial  differential  equation  which  must  be 

* , 

satisfied  by  the  density  of  the  stationary  distribution  of  Z (if  one 
exists) . Althou^  this  equation  has  not  been  solved  in  general,  a 
family  of  special  cases  has  been  solved,  and  this  solution  is  displayed. 
In  addition,  the  solution  originally  proposed  by  Xobayashi  (19^^)  is 
substituted  into  the  equations  and  a family  of  cases  for  which  his 
solution  works  is  derived. 

We  need  the  following  result,  a proof  of  which  appears  in 
Azema,  Kaplan-Deflo,  and  Re.vuz  (1966). 


Lemma  1.  Suppose  -rr  is  a probability  distribution  on  IR^.  Then 

* 

is  a stationary  distribution  of  Z if  and  only  if 

/ >fih(x)  vCdx'  - 0 


for  all  h € ^ . 


We  can  now  prove  the  following  result. 


ProDCsltlon  3.  If  Z has  a stationary  distribution  with  density  v, 


then  IT  satisfies 


i ? ^ 2 . aTT 


(»>  ? 'i  1-  ° 

' i=l  j=l  1 j i=l  i 


(“>  ? 4 <?  ^*'13  * ''?3>  % • 'I’'-’'*  “ ° 


when  x^.  = 0,  x > 0 for  J ^ i,  for  1 < i < K. 


Proof.  The  equations  will  be  obtained  by  integration  by  parts -on 


(21)  <■  ^ y6h(x)  ■p-(x'  dx  = 0 

for  h G We  need  to  fiarther  restrict  the  class  of  functions  con- 

sidered to  .justify  the  integration  by  parts.  Let 

I(x)  = (1  1 i < K|x^  = 0}  for  X £ 


]R“  = (x  e B^l  !l(x)  I < 1] 


Then  IR^  is  simply  IR^  with  all  of  the  comers  removed.  Let 
Q'  be  the  set  of  all  functions  from  IR  ^ IR  whzch  have  derivatives 


V 

of  all  orders  when  restricted  to  !R^.  Since  tt  is  a density,  Weyl's 
lemma  (McKean  (1969),  Section  h.2)  says  that  we  can  assume  tt  £ 

iO  K 

Let  be  the  subset  of  (c  (functions  mapping  ->]R  with  bounded 

derivatives  of  all  orders)  which  in  addition  vanish  off  a compact  subset 
of  If  we  restrict  our  attention  to  h € ^ ",  Fubini's  theorem 

and  the  fact  that  tt  £ ’ O’istify  the  operations  involved  in  the 

integrations  by  parts. 

3y  simple  manipulation  we  get 


(22) 

00 

/ h.(x)  7r(x)  dx.  = -h(x^; 

0 ^ ^ 

00 

g(x^)  - / h(x)  TT,  (x)dx 

0 

for  X € eJJ 

and  1 < i < K , 

+ 

00  00 

(23)  I f 

0 0 

h^^(x)  7r(x)  dx^dx^ 

= / h(x^)  7r.(x^)dx.  + h(x^)  •Tr.(x^)dx. 

0 ^ ^ 0 : J 

00  00 

+ / / h(x)  IT,  .(x)  dx  dx 

06  ^ 


f 


1 

l\ 

Vji 

•1'’ 

i--, 

li 


I 


for  X € ]R^  and  1 < 1 < K.  The  last  expression  still  has  a term 
with  a derivative  on  h which  cannot  eliminate  by  an  integration 
by  parts  because  there  is  no  longer  an  integration  with  respect  to  that 
variable.  Since  h € n ^ , we  know  that  h satisfies  the  boundary 


condition 


h,  (x^)  = E p,  .h  fx  ' for  X £ ]R^  and  1 < 1 < K 

1 o 


We  can  use  this  to  get 


(25}  h.(x^'  7r(x^}  dx^  = / S p.  .h  (x^)  7t(x^')  dx 

' K-1  ^ _K-1  j=l 


- Z f p.  .h(x^)  V^(x^)  dx^. 

j=l  ^ 


Substituting  (22) -(25)  into  (21), 

* K K 2 K 

<■  h(x)  i Z Z ^ ' (x)  - Z Cj^  (x)  dx 

■ K - i-1  J=1  i=l  ^ ■^"'i 

^ 4- 

->■  Z f h(x^)  I If-  (x^)  + E (|  cr^p.^  + CT^.'  ^ (x^)-c  v(x^)1dx^  = 

i=l  ^K-1  L"  ^ ""i  J?^i  ^ j J 

Since  this  must  hold  for  all  f £ fi".  all  of  the  terras  in  square  brackets 
mu.st  be  zero.  This  yields  (19)  and  (20). 

Proposition  5 only  gives  a neceesary  condition  for  the  stationary 
distribution.  Given  that  a stationary  distribution  with  a density 
exists,  the  same  condition  would  be  sufficient  if  it  were  possible  to 
show  uniqueness  of  the  solution  for  (19)  and  (20)  among  the  class  of 


X 


probability  density  functions.  This  problem  has  not  been  addressed 
in  the  theory  of  partial  differential  equations  and  so  a sufficient 
condition  is  not  available. 


6.3.  Exponential  Solutions 

The  general  solution  to  (l9)  and  {20)  is  not  presently  known. 
However,  we  are  able  to  solve  the  equations  for  a family  of  special 
cases.  These  special  cases  correspond  to  limit  processes  which  are 
achievable  by  sequence  of  Jackson  networks.  We  know  the  ejq)licit 
form  of  the  stationary  distribution  for  a Jackson  network  from  (l.l). 

In  what  follows,  we  carry  through  a purely  formal  calculation  to  obtain 
the  limit  of  a sequence  of  stationary  distributions  of  Jackson  networks. 
Although  there  is  no  rigorous  result  saying  that  the  limit  will  be  the 
stationary  distribution  of  the  limit  process,  it  turns  out  that  the 
calculated  limit  solves  (19)  and  (20). 

We  consider  a sequence  of  Jackson  networks.  The  distributional 
assumptions  yield 

S:5(n)  = ;u^(n)]“^  and  a^(n)  = [X^(n)]“^ 

for  1 < i < K and  n > 1.  Substituting  this  into  the  definition  of  ^ 
(equations  (3.11)  and  (3*12)),  we  obtain 

(26)  = lim  (A^(n)  + uj_(n))  = 2^^ 

n 00 
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so  that 


1 ^ . 
= " 2 Vji' 


This  relation  determines  the  family  of  special  cases  for  which  we  solve 
the  equations. 

From  Faction  1.5  we  know  that  for  a Jackson  network  with 
traffic  Intensity  vector  £ = (o^,  ...  , 


IV  U, 

7r(n^.  ...  , n^)  = IT  (I-d^)o^’'  . 


irCn^,  ...  , n^)  = •••  E Tr(j’  , ...  , j„)  , 


n(n^,  ...  . n^}  = (1  - ) 


A simple  calculation  shows  that  the  condition  {^{n) \/n -*  c 
as  n is  equivalent  to  ■ *6^'^' ■ V cR  as  n -»».  This 

yields  1 - ij^(n  )]  -»  (cR)^/u^  as  n -»«>.  We  explicitly  teike 


limits  in  (29)  to  get 


n(x  , , . . , x^)  = n (l-e 
^ ^ i=l 


K - d X.  „ 

n (l-e  ^ ) for  X € ]R^ 


Thus 


and  substituting  this  into  (19)  and  (20)  verifies  that  it  is  a solution 


Kobayashi's  Solution 


Kobayashi  (197^'  proposed 


As  was  mentioned  in  Section 


a diffusion  approximation  for  queueing  net'A-orks  and  presented  a 


stationary  distribution  for  his  approxLmation.  Although  his  diffusion 


process  was  not  completely  determined,  the  stationary  distribution  he 


presented  actually  sol\'-e 


We  determine  this  family  of 


;pecial  cases  below,  showing  that  it  is  a 


subset  of  the  family  of  cases  dealt  with  in  the  last  section 


Kobayashi's  stationaxy  distribution  is 


but  substituting  (31) 


where  d 


20)  to  be  satisfied  we  must  have 


We  take  the  point  of  view  that  subject  to  > 0 for  1 < i £ K, 
we  want  the  solution  to  work  for  any  d.  Thus  we  clearly  must  have 

? ^ y 2 2 

cr.  . = - cr.p,  . for  1 < I < K and  j * i.  Since  a.  . = cr..  for 

ij  i ij  - - id  ji 

2 2 

1 < i,  j < K this  implies  ‘:hat  o.  . = - cr.p.  . = - cr.p..  and  this 

lid  d d ^ 

is  seen  to  be  a subclass  of  the  limits  achievable  by  Jackson  networks. 


CHAPTER  7 


L 


EXTENSIONS 

In  this  chapter  we  deal  with  several  extensions  to  the  queueing 
network  model  originally  described  in  Section  1.2.  These  extensions 
vere  left  out  of  the  original  model  for  the  sake  of  improved  readability. 
For  some  of  these  extensions,  the  proof  ar:ounts  simply  to  the  observa- 
tion that  the  old  proof  still  works,  while  for  others  the  old  proof 
needs  a small  modification. 

7.1.  Self -Feedback 

The  first  extension  is  to  certain  kinds  of  non-FEFO  disciplines. 

We  will  allow  any  discipline  where  customers  are  not  preempted  in  the 
middle  of  service,  the  server  is  not  idle  while  customers  are  waiting, 
and  no  knowledge  about  the  customers’  service  time  is  used  in  deciding 
which  customer  to  serve  next.  The  disciplines  at  different  stations 
can  be  different.  This  generality  is  allowed  because  it  involves  no 
change  in  the  actual  vector  queue  length  process.  This  would  not  be 
the  case  if  we  were  investigating  customer  waiting  times. 

We  can  now  show  that  the  assumption  ^ ^ 1 ^ 1 ^ 

is  wit)iout  loss  of  generality.  If  p^^^  > 0 then  it  is  possible 
for  a customer  to  return  to  a station  immediately  after  completing 
service  there.  We  could  define  the  discipline  at  stations  with  Pj^^^  > 0 
to  be  such  that  a customer  '.ho  is  routed  back  to  the  same  station  re-enters 
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having  the  customer  leave  service  and  immediately  re-enter  with  prob- 
ability > 0,  the  same  effect  is  achieved  if  the  service  time 

distribution  is  redefined  to  be  a geometric  mixture  of  successive 
convolutions  of  the  original  service  time  distribution.  Thus  if  the 
service  time  distribution  at  station  i is  "the  new  service  time 

/s 

distribution  G^f-)  is  given  by 


G^(t)  = E for  t > 0 , 

n=l 


'^D 

where  G^  is  the  nth  convolution  of  with  itself.  For  the  new 


routing  probabilities  we  obtain 


Pii  =0 


PiJ  =Pij''---"ii' 


We  have  thus  transformed  the  case  p^^^  > 0 into  p^^  = 0,  without 
affecting  the  vector  queue  length  process. 


7.2.  Mu-lti-Server  Stations 

The  extension  to  multi-server  stations  is  mathematically 
straightforward,  but  notationally  difficult.  We  merely  outline  the 
proof  since  the  original  proof  for  single  server  stations  needs  very 
little  modification  to  cover  this  extension. 
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“ki: 


= 1/E[v^  J > 0 and  = var(v^P  >0,  l<i<K, 


k£' 


Let 


^ki  ®k  ""  ‘-kP.\f.  ’ 


1 < k < K 


Let  Sj^  = (Sj^(t).  t > 0}  be  the  renewal  process  foraed  by  potential 
services  of  server  £ at  station  k.  Also,  define  ^ 

to  be  the  counting  process  for  which  S,  ./t)  is  the  nuriber  of  potential 
services  completed  by  server  £ at  station  k during  [0,t]  where 
routing  indicators  pointed  to  station  j.  Now  define  the  random  walk 
X = (X(t),  t > 0 }by 

^k  K 

x,(t)  . A^(t>  - S^(t'  > Z^  1 < k < K,  t > 0 . 

We  assume  that  all  of  the  processes  Aj^,  for  1 < k,  i < K 

are  mutually  independent  so  that  the  seauence  of  random  walks  constructed 
as  in  the  single  server  case  converges  to  a multidimensional  Brownian 
motion.  If  we  define 

X*^(t)  = n"‘^^x"(nt)  for  0 < t < 1.  n > 1 , 


I 

f 


I 

I 
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then  in  complete  analogy  with  Theorem  1 we  obtain  X n-><», 

* 

where  X is  exactly  as  defined  in  Theorem  1. 

The  rest  of  the  convergence  proof  proceeds  as  before.  The 
Borovkov  network  is  changed  to  correspond  to  Borovkov's  modification 
for  multi-server  queues.  The  main  change  from  the  single  server  case 
is  that  a customer  is  assigned  to  the  server  who  would  end  up  completing 
his  seirvice  first.  This  is  not  always  the  first  server  to  become  idle. 
Otherwise  the  Borovkov  network  is  the  seme  as  before.  The  l/O  network 
is  defined  as  before,  and  the  RRW  is  constructed  from  X exactly  as 
before.  The  proofs  of  Propositions  5.1>  5.2,  and  5-3  are  the  same  as 
before,  with  the  only  added  complexity  being  a more  ciombersome  notation. 
The  final  result  is  that  Theorem  5 holds  for  the  multi-server  case. 


7.3.  Wea-Renewal  Input 

In  the  original  model  it  was  assumed  that  the  input  processes 
are  all  renewal  processes.  The  only  place  this  assumption  was 
actually  used  was  in  the  proof  of  Theorem  1.  The  renewal  nature  of 
A was  used  to  show  that  the  scaled  and  normalized  processes  A, 
converge  weakly  to  Brownian  motion.  Instead  of  assuming  to  be 

a "enewal  process,  we  can  simply  assume  that  the  sequence  A|^(n*; 
can  be  scaled  and  normalized  to  form  a sequence  which  converges 

weakly  to  Brownian  motion.  The  scaling  parameters  play  the  role  of 


Ok 


arrival  rates. 


To  show  that  this  generalization  is  actually  useful,  we  give 
an  example  where  it  can  be  applied.  The  example  involves  an  arrival 


process  introduced  by  Anderson  (1975)  which  he  calls  an  appointments 
process.  Arrivals  are  scheduled  for  times  i > 1,  with  the  ith 
scheduled  arrival  being  unpunctual  by  an  amount  w^,  where  i > 1] 

forms  an  i.i.d.  sequence  having  common  distribution  F(-)-  Thus 
the  ith  scheduled  arrival  actually  arrives  at  i + w^.  We  assume 
F to  be  an  imperfect  distribution  function  and  let  q = l-  F(<»)>0. 
This  corresponds  to  having  a probability  q > 0 that  a scheduled 
customer  will  never  arrive.  It  is  also  assumed  that  ''  xF(dx)  < 

‘ mOO 

Let  A = {A(t),  t > 0)  be  the  counting  process  where  A(t)  is  the 
number  of  arrivals  d'uring  {-“,t]  and  set 

= [q(l-q)n]”*'^^  [A(nt)  - E F(nt-i)],  0 < t < 1,  n > 1. 

i=0 

Anderson's  main  result  is  that  A 6 -vdiere  3 is  a standard 

Brownian  motion.  Thus  we  can  use  an  appointment  process  as  input 
for  smy  number  of  stations  in  the  network  and  obtain  the  same  diffusion 
limit  as  in  the  original  model.  In  order  to  match  the  variance  here 
with  the  original  model,  set  a^  = q^Cl-q^^''  if  station  i has  an 
appointments  process  input. 

There  are  other  cases  where  the  additional  generality  allowed 
by  this  section  is  helpful.  An  important  case  is  that  of  thinned  and 
superimposed  renewal  processes.  Thus  a station  could  have  two  or  more 
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The  principle  purpose  of  this  report  is  to  state  and  prove  a limit 
rem  which  justifies  a diffusion  approximation  for  general  queueing 
orks 

JIi*«^tructure  of  the  network  is  as  follows.  There  are  K single 
er  stations,  each  with  independent  and  identically  distributed  (i.i.d) 
ice  times.  Each  station  may  have  its  own  input  from  outside  the  network, 
interarrival  times  being  lid.  In  addition,  all  of  the  service  and 
rarrival  time  sequences  are  mutually  independent.  The  service  and 
rarrival  distributions  can  be  arbitrary  as  long  as  they  have  finite 
ances.  Customers  completing  service  at  a station  are  routed  randomly 
er  to  another  station  or  out  of  the  network.  The  routing  probabilities 
elements  of  a K x K.  substochastic  matrix  P,  called  the  routing  . 
ix.  Each  row  defect  gives  the  probability  of  a customer  leaving  the 
am  after  completing  service  at  the  associated  station.  The  routing 
cators  are  independent  of  all  other  events  in  the  process. 

■ Vve  are  interested  in*the  K-dimensional  vector  queue  length  process 
the  network.  Because  of  the  general  form  assumed  for  the  interarrival 
service  distributions,  the  process  has  no  special  structure  such  as  the 
ov  property.  In  this  generality,  the  network  has  proven  to  be 

actable,  hence  the  desire  for  an  approximation. ___ 

In  direct  analogy  with  standard  single  server  queueing  systems,^ it  is 
ible  to  define  a traffic  intensity  for  each  station  in  the  network, 
y traffic  is  said  to  hold  when  all  stations  have  traffic  intensities 
e to  unity.  Mathematically,  heavy  traffic  is  interpreted  through 
Ideration  of  a sequence  of  queueing  networks  indexed  (say)  by  n,  each 
its  own  parameters,  defined  in  such  a way  that  the  traffic  intensity 
ach  station  approaches  unity  as  n approaches  infinity..  The  vector 
e length  process  tends  to  grow  without  bound  when  the  tr^^fic 
nsltles  are  greater  than  unity  or  approach  it  from  below,  so  it  is 
ssary  to  normalize  the  sequence  of  processes  to  obtain  a londegenerate 
t.  Thus  the  main  result  states  that  if  we  have  a properl/  normalized 
ence  of  queueing  networks  with  traffic  intensities  appro^hing  unity 
the  correct  rate),  it  converges  to  a certain  multi-dimeniional  diffusion 
ess.  I 

We  next  turn  to  a study  of  the  limit  diffusion  process. ^The  state  space 
he  limit  process  is  the  K-dimensional  non-negative  orthant.  On  the 
rlor  of  its  state  space  the  process  behaves  as  a wultidimensional 
nian  motion  with  an  easily  computed  drift  vector  and  covariance  matrix, 
ach  boundary  surface  the  process  reflects  instantaneously.  The 
ctlons  of  reflection  are  given  by  a simple  expression  involving  only 
routing  matrix.  After  jro^ing  that  the  limit  process  is  a diffusion, 

its  generator,”  justifying  the  above  description.*^. 

We  then  derive  a necessary  condition  for  a probability  density  function 
e a stationary  density  for  the  limit  process.  Specifically,  we  show  that 
density  of  a stationary  distribution,  if  one  exists,  must  satisfy  a 
ain  partial  differential  equation  with  boundary  conditions.  Although 
equation  has  not  been  solved  in  general,  a family  of  special  cases  is 
ed. 
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